You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/20 08:33:12 UTC

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1393 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1393/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseSerialGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=5757, name=jetty-launcher-1177-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)    2) Thread[id=5759, name=jetty-launcher-1177-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=5757, name=jetty-launcher-1177-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   2) Thread[id=5759, name=jetty-launcher-1177-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
	at __randomizedtesting.SeedInfo.seed([242DBE4CED5DDBF4]:0)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:39489/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:43905/solr/MoveReplicaHDFSTest_failed_coll_true]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:39489/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:43905/solr/MoveReplicaHDFSTest_failed_coll_true]
	at __randomizedtesting.SeedInfo.seed([242DBE4CED5DDBF4:8EE06DBE5A8E0E24]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:306)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39489/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard2
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
	... 46 more


FAILED:  org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:41629_solr, 127.0.0.1:45925_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/20)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"testSimple1_shard1_replica_n1",           "base_url":"http://127.0.0.1:45925/solr",           "node_name":"127.0.0.1:45925_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node12":{           "core":"testSimple1_shard1_replica_n11",           "base_url":"http://127.0.0.1:45925/solr",           "node_name":"127.0.0.1:45925_solr",           "state":"active",           "type":"NRT"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node7":{           "core":"testSimple1_shard2_replica_n4",           "base_url":"http://127.0.0.1:45925/solr",           "node_name":"127.0.0.1:45925_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node10":{           "core":"testSimple1_shard2_replica_n9",           "base_url":"http://127.0.0.1:46533/solr",           "node_name":"127.0.0.1:46533_solr",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:41629_solr, 127.0.0.1:45925_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/20)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"testSimple1_shard1_replica_n1",
          "base_url":"http://127.0.0.1:45925/solr",
          "node_name":"127.0.0.1:45925_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node12":{
          "core":"testSimple1_shard1_replica_n11",
          "base_url":"http://127.0.0.1:45925/solr",
          "node_name":"127.0.0.1:45925_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "core":"testSimple1_shard2_replica_n4",
          "base_url":"http://127.0.0.1:45925/solr",
          "node_name":"127.0.0.1:45925_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node10":{
          "core":"testSimple1_shard2_replica_n9",
          "base_url":"http://127.0.0.1:46533/solr",
          "node_name":"127.0.0.1:46533_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([242DBE4CED5DDBF4:1C9E9AB2CAAE0F25]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12839 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
   [junit4]   2> 931224 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/init-core-data-001
   [junit4]   2> 931225 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 931225 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 931227 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 931285 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   2> 931407 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/tempDir-001
   [junit4]   2> 931407 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 931407 INFO  (Thread-1078) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 931407 INFO  (Thread-1078) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 931410 ERROR (Thread-1078) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 931507 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:45615
   [junit4]   2> 931512 INFO  (zkConnectionManagerCallback-1180-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931518 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 931524 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 931530 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 931530 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 931530 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 931534 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 931534 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 931534 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 931534 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a27937{/solr,null,AVAILABLE}
   [junit4]   2> 931534 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c3c3c2{/solr,null,AVAILABLE}
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@426307{HTTP/1.1,[http/1.1]}{127.0.0.1:41693}
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.e.j.s.Server Started @932651ms
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41693}
   [junit4]   2> 931537 ERROR (jetty-launcher-1177-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 931537 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T07:40:54.222Z
   [junit4]   2> 931538 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7bc6b9{HTTP/1.1,[http/1.1]}{127.0.0.1:34475}
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.e.j.s.Server Started @932653ms
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34475}
   [junit4]   2> 931539 ERROR (jetty-launcher-1177-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 931539 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T07:40:54.224Z
   [junit4]   2> 931543 INFO  (zkConnectionManagerCallback-1182-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931544 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 931546 INFO  (zkConnectionManagerCallback-1184-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931546 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 931553 INFO  (jetty-launcher-1177-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45615/solr
   [junit4]   2> 931558 INFO  (zkConnectionManagerCallback-1188-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931562 INFO  (jetty-launcher-1177-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45615/solr
   [junit4]   2> 931566 INFO  (zkConnectionManagerCallback-1192-thread-1-processing-n:127.0.0.1:41693_solr) [n:127.0.0.1:41693_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931568 INFO  (zkConnectionManagerCallback-1194-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931577 INFO  (zkConnectionManagerCallback-1196-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 931683 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 931684 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41693_solr
   [junit4]   2> 931686 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.Overseer Overseer (id=72180514311831556-127.0.0.1:41693_solr-n_0000000000) starting
   [junit4]   2> 931699 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41693_solr
   [junit4]   2> 931708 INFO  (OverseerStateUpdate-72180514311831556-127.0.0.1:41693_solr-n_0000000000) [n:127.0.0.1:41693_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 931709 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 931710 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 931712 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34475_solr
   [junit4]   2> 931722 INFO  (zkCallback-1191-thread-2-processing-n:127.0.0.1:41693_solr) [n:127.0.0.1:41693_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 931742 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 931874 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 931876 WARN  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 931884 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 931884 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 931884 WARN  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 931888 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 931996 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 931998 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 932021 INFO  (jetty-launcher-1177-thread-2-EventThread) [n:127.0.0.1:41693_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 932021 INFO  (jetty-launcher-1177-thread-1-EventThread) [n:127.0.0.1:34475_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 932198 WARN  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 932201 WARN  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 932260 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41693.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932267 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34475.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932281 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34475.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932281 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34475.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932283 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41693.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932283 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41693.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 932283 INFO  (jetty-launcher-1177-thread-1) [n:127.0.0.1:34475_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/tempDir-001/node1/.
   [junit4]   2> 932285 INFO  (jetty-launcher-1177-thread-2) [n:127.0.0.1:41693_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/tempDir-001/node2/.
   [junit4]   2> 932376 INFO  (zkConnectionManagerCallback-1202-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 932395 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 932413 INFO  (qtp12195151-5710) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 932413 INFO  (qtp12195151-5710) [n:127.0.0.1:34475_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 932414 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 932430 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 932451 WARN  (qtp12195151-5717) [    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ???bar???: no such user
   [junit4]   2> id: ???bar???: no such user
   [junit4]   2> 
   [junit4]   2> 932789 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 932803 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 932804 INFO  (qtp12195151-5721) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 932805 WARN  (qtp12195151-5721) [    ] o.e.j.s.HttpChannel /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:460)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
   [junit4]   2> 	... 31 more
   [junit4]   2> 932808 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 932822 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 932827 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 932842 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 932843 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 932843 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 932844 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 932860 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 932864 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 932877 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 932884 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 932885 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 932885 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 932899 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
   [junit4]   2> 932900 INFO  (zkConnectionManagerCallback-1205-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 933153 INFO  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 933154 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 933155 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45615/solr ready
   [junit4]   2> 933158 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 933159 INFO  (OverseerThreadFactory-1942-thread-1-processing-n:127.0.0.1:41693_solr) [n:127.0.0.1:41693_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
   [junit4]   2> 933266 INFO  (OverseerStateUpdate-72180514311831556-127.0.0.1:41693_solr-n_0000000000) [n:127.0.0.1:41693_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"forwardingCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"forwardingCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34475/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 933470 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 933471 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 933578 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 933578 INFO  (zkCallback-1195-thread-2-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 934519 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 934560 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 934661 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 934690 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
   [junit4]   2> 934691 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34475.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a58d45
   [junit4]   2> 934691 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 934691 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_242DBE4CED5DDBF4-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
   [junit4]   2> 934695 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1e9f933
   [junit4]   2> 934783 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 934784 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 934785 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 934786 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 934788 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1328784150, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 934788 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@11c93fe[forwardingCollection_shard1_replica_n1] main]
   [junit4]   2> 934791 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 935084 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 935188 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 935188 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 935188 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592904864626638848
   [junit4]   2> 935188 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 935189 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 935189 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 935189 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 935189 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 935189 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 935190 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 935190 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 935193 INFO  (searcherExecutor-1947-thread-1-processing-n:127.0.0.1:34475_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@11c93fe[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34475/solr/forwardingCollection_shard1_replica_n1/
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:34475/solr/forwardingCollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 935196 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 935198 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34475/solr/forwardingCollection_shard1_replica_n1/ shard1
   [junit4]   2> 935300 INFO  (zkCallback-1195-thread-2-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 935300 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 935349 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 935351 INFO  (qtp12195151-5711) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1881
   [junit4]   2> 935354 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 935451 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 935451 INFO  (zkCallback-1195-thread-2-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 936354 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3196
   [junit4]   2> 936355 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
   [junit4]   2> 936355 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
   [junit4]   2> 936360 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 936363 INFO  (qtp31847623-5706) [n:127.0.0.1:41693_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 936366 INFO  (qtp12195151-5719) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 936367 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
   [junit4]   2> 936393 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 948864 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]-SendThread(127.0.0.1:45615)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 12508ms for sessionid 0x1006fcb9b43000b
   [junit4]   2> 948864 WARN  (jetty-launcher-1177-thread-1-SendThread(127.0.0.1:45615)) [n:127.0.0.1:34475_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16682ms for sessionid 0x1006fcb9b430008
   [junit4]   2> 948864 WARN  (jetty-launcher-1177-thread-2-SendThread(127.0.0.1:45615)) [n:127.0.0.1:41693_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16681ms for sessionid 0x1006fcb9b430007
   [junit4]   2> 948864 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1006fcb9b430008, likely client has closed socket
   [junit4]   2> 948864 WARN  (jetty-launcher-1177-thread-1-SendThread(127.0.0.1:45615)) [n:127.0.0.1:34475_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13412ms for sessionid 0x1006fcb9b430006
   [junit4]   2> 948864 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1006fcb9b430007, likely client has closed socket
   [junit4]   2> 948864 INFO  (OverseerCollectionConfigSetProcessor-72180514311831556-127.0.0.1:41693_solr-n_0000000000) [n:127.0.0.1:41693_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 948864 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1006fcb9b430006, likely client has closed socket
   [junit4]   2> 948867 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 948883 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
   [junit4]   2> 948892 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
   [junit4]   2> 948911 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
   [junit4]   2> 948965 WARN  (zkConnectionManagerCallback-1196-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1040666 name: ZooKeeperConnection Watcher:127.0.0.1:45615/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 948965 WARN  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f9a330 name: ZooKeeperConnection Watcher:127.0.0.1:45615/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 948965 WARN  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 948965 WARN  (zkConnectionManagerCallback-1196-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 951654 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[242DBE4CED5DDBF4]-SendThread(127.0.0.1:45615)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x1006fcb9b43000b has expired
   [junit4]   2> 951654 WARN  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f9a330 name: ZooKeeperConnection Watcher:127.0.0.1:45615/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 951655 WARN  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 951655 INFO  (jetty-launcher-1177-thread-2-EventThread) [n:127.0.0.1:41693_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 951656 WARN  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 951656 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
   [junit4]   2> 951656 INFO  (jetty-launcher-1177-thread-1-EventThread) [n:127.0.0.1:34475_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 951661 INFO  (zkConnectionManagerCallback-1208-thread-1-EventThread) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 951661 INFO  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 951662 INFO  (zkConnectionManagerCallback-1196-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 951670 INFO  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 951670 INFO  (zkConnectionManagerCallback-1208-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient Connected:true
   [junit4]   2> 951680 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 951684 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[242DBE4CED5DDBF4]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 951689 INFO  (jetty-closer-1178-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@426307{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 951689 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=13034728
   [junit4]   2> 951689 INFO  (jetty-closer-1178-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7bc6b9{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 951689 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 951690 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=19268396
   [junit4]   2> 951690 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11532ed: rootName = solr_41693, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ba56c9
   [junit4]   2> 951690 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 951690 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18a9fc7: rootName = solr_34475, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3d882e
   [junit4]   2> 951700 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 951700 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 951700 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ca5949: rootName = solr_41693, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1519531
   [junit4]   2> 951700 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1021e08: rootName = solr_34475, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1519531
   [junit4]   2> 951708 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 951708 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f87f46: rootName = solr_41693, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@959bc
   [junit4]   2> 951709 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 951710 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@9c0302: rootName = solr_34475, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@959bc
   [junit4]   2> 951710 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41693_solr
   [junit4]   2> 951710 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 951711 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34475_solr
   [junit4]   2> 951711 INFO  (zkCallback-1191-thread-1-processing-n:127.0.0.1:41693_solr) [n:127.0.0.1:41693_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 951712 INFO  (jetty-closer-1178-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72180514311831556-127.0.0.1:41693_solr-n_0000000000) closing
   [junit4]   2> 951712 INFO  (OverseerStateUpdate-72180514311831556-127.0.0.1:41693_solr-n_0000000000) [n:127.0.0.1:41693_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41693_solr
   [junit4]   2> 951712 INFO  (zkCallback-1195-thread-5-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 951713 INFO  (zkCallback-1191-thread-1-processing-n:127.0.0.1:41693_solr) [n:127.0.0.1:41693_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 951713 INFO  (jetty-closer-1178-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 951713 WARN  (OverseerAutoScalingTriggerThread-72180514311831556-127.0.0.1:41693_solr-n_0000000000) [n:127.0.0.1:41693_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 951713 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 951714 INFO  (coreCloseExecutor-1953-thread-1) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@13c91a4
   [junit4]   2> 951714 INFO  (coreCloseExecutor-1953-thread-1) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=20746660
   [junit4]   2> 951714 INFO  (coreCloseExecutor-1953-thread-1) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2c20fc: rootName = solr_34475, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1d2be8a
   [junit4]   2> 951715 INFO  (zkCallback-1195-thread-1-processing-n:127.0.0.1:34475_solr) [n:127.0.0.1:34475_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34475_solr
   [junit4]   2> 951715 ERROR (Thread[Thread-1097,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:41693_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 951725 INFO  (jetty-closer-1178-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a27937{/solr,null,UNAVAILABLE}
   [junit4]   2> 951725 INFO  (jetty-closer-1178-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 951737 INFO  (coreCloseExecutor-1953-thread-1) [n:127.0.0.1:34475_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=20746660
   [junit4]   2> 951740 ERROR (Thread[Thread-1095,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:34475_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 951741 INFO  (jetty-closer-1178-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1c3c3c2{/solr,null,UNAVAILABLE}
   [junit4]   2> 951741 INFO  (jetty-closer-1178-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 951741 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 951741 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45615 45615
   [junit4]   2> 952469 INFO  (Thread-1078) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45615 45615
   [junit4]   2> 952470 WARN  (Thread-1078) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/collections/forwardingCollection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/collections/forwardingCollection/state.json
   [junit4]   2> 	4	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 952483 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 20, 2018 7:41:15 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Feb 20, 2018 7:41:35 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]   2>    1) Thread[id=5757, name=jetty-launcher-1177-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2>    2) Thread[id=5759, name=jetty-launcher-1177-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> Feb 20, 2018 7:41:35 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=5757, name=jetty-launcher-1177-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>    2) Thread[id=5759, name=jetty-launcher-1177-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation

[...truncated too long message...]

hard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=20741078
   [junit4]   2> 2783134 INFO  (coreCloseExecutor-8560-thread-5) [n:127.0.0.1:45925_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple1.shard1.replica_n11, tag=20746977
   [junit4]   2> 2783135 INFO  (coreCloseExecutor-8560-thread-5) [n:127.0.0.1:45925_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b66b8e: rootName = solr_45925, domain = solr.core.testSimple1.shard1.replica_n11, service url = null, agent id = null] for registry solr.core.testSimple1.shard1.replica_n11 / com.codahale.metrics.MetricRegistry@1ec313d
   [junit4]   2> 2783143 INFO  (coreCloseExecutor-8560-thread-5) [n:127.0.0.1:45925_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=20746977
   [junit4]   2> 2783143 INFO  (coreCloseExecutor-8560-thread-1) [n:127.0.0.1:45925_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=18181312
   [junit4]   2> 2783144 INFO  (jetty-closer-4188-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72180626446745609-127.0.0.1:45925_solr-n_0000000002) closing
   [junit4]   2> 2783144 INFO  (OverseerStateUpdate-72180626446745609-127.0.0.1:45925_solr-n_0000000002) [n:127.0.0.1:45925_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45925_solr
   [junit4]   2> 2783144 WARN  (OverseerAutoScalingTriggerThread-72180626446745609-127.0.0.1:45925_solr-n_0000000002) [n:127.0.0.1:45925_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2783145 DEBUG (jetty-closer-4188-thread-2) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 2783146 INFO  (jetty-closer-4188-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1fea4bc{/solr,null,UNAVAILABLE}
   [junit4]   2> 2783146 INFO  (jetty-closer-4188-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2783146 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2783146 INFO  (SUITE-AutoAddReplicasIntegrationTest-seed#[242DBE4CED5DDBF4]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46739 46739
   [junit4]   2> 2788172 INFO  (Thread-8288) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46739 46739
   [junit4]   2> 2788173 WARN  (Thread-8288) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/collections/testSimple1/terms/shard2
   [junit4]   2> 	6	/solr/collections/testSimple1/terms/shard1
   [junit4]   2> 	5	/solr/collections/testSimple2/terms/shard2
   [junit4]   2> 	5	/solr/collections/testSimple2/terms/shard1
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf
   [junit4]   2> 	3	/solr/collections/testSimple3/terms/shard3
   [junit4]   2> 	3	/solr/collections/testSimple3/terms/shard2
   [junit4]   2> 	3	/solr/collections/testSimple3/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/collections/testSimple1/state.json
   [junit4]   2> 	12	/solr/collections/testSimple2/state.json
   [junit4]   2> 	10	/solr/collections/testSimple3/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72180626446745608-127.0.0.1:46533_solr-n_0000000000
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/collections/testSimple1/leader_elect/shard2/election/72180626446745609-core_node7-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_242DBE4CED5DDBF4-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=534, maxMBSortInHeap=5.860250714307602, sim=RandomSimilarity(queryNorm=false): {}, locale=es-ES, timezone=America/Nassau
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=97968232,total=483274752
   [junit4]   2> NOTE: All tests run in this JVM: [SortSpecParsingTest, TestSchemaVersionResource, OverseerTest, CollectionReloadTest, TestNoOpRegenerator, HdfsThreadLeakTest, SolrCoreTest, TestSolrCoreSnapshots, TestEmbeddedSolrServerAdminHandler, TestCollectionAPI, TestPayloadScoreQParserPlugin, TestSchemaNameResource, TestConfigOverlay, PreAnalyzedUpdateProcessorTest, TestSQLHandlerNonCloud, TestFunctionQuery, TestPivotHelperCode, SolrMetricManagerTest, DocumentBuilderTest, IndexSchemaTest, CdcrBootstrapTest, TestSurroundQueryParser, SolrCloudExampleTest, StatsReloadRaceTest, TestBM25SimilarityFactory, HttpSolrCallGetCoreTest, BlockJoinFacetSimpleTest, JvmMetricsTest, TestLeaderElectionZkExpiry, TestFieldResource, TestCharFilters, TestSimpleTrackingShardHandler, TestSolrCLIRunExample, DirectSolrConnectionTest, TestSolrCloudWithKerberosAlt, CreateRoutedAliasTest, TestReqParamsAPI, TestSolrConfigHandler, ClassificationUpdateProcessorIntegrationTest, AlternateDirectoryTest, TestNestedDocsSort, TestFastLRUCache, ZkFailoverTest, DistributedIntervalFacetingTest, TestSolrJ, UUIDUpdateProcessorFallbackTest, BasicZkTest, SignatureUpdateProcessorFactoryTest, PeerSyncTest, LegacyCloudClusterPropTest, ConfigSetsAPITest, PathHierarchyTokenizerFactoryTest, TestMinMaxOnMultiValuedField, TestLegacyTerms, RequiredFieldsTest, TestSizeLimitedDistributedMap, AutoscalingHistoryHandlerTest, TestNumericRangeQuery64, OverseerRolesTest, TestSystemIdResolver, TestManagedStopFilterFactory, SliceStateTest, TestMacroExpander, AddReplicaTest, TestDownShardTolerantSearch, HdfsDirectoryTest, DistributedFacetSimpleRefinementLongTailTest, TestStressVersions, BJQParserTest, LargeFieldTest, SystemInfoHandlerTest, CoreMergeIndexesAdminHandlerTest, FileUtilsTest, TestStressInPlaceUpdates, SolrShardReporterTest, SpatialHeatmapFacetsTest, TestLRUCache, TestSchemaManager, QueryElevationComponentTest, TestRawTransformer, SampleTest, TestSSLRandomization, TestHdfsUpdateLog, BitVectorTest, ShardRoutingCustomTest, SuggesterFSTTest, TestDistributedGrouping, TestJettySolrRunner, OverriddenZkACLAndCredentialsProvidersTest, ZkControllerTest, TestFoldingMultitermQuery, CoreSorterTest, ZkStateReaderTest, SyncSliceTest, SolrGangliaReporterTest, SchemaApiFailureTest, RuleEngineTest, TestHashQParserPlugin, MultiThreadedOCPTest, TestDynamicFieldCollectionResource, TestMaxScoreQueryParser, DeleteStatusTest, TestSolrFieldCacheBean, TestCloudDeleteByQuery, HdfsRecoveryZkTest, UpdateRequestProcessorFactoryTest, BadComponentTest, HdfsDirectoryFactoryTest, HdfsBasicDistributedZk2Test, TestPullReplica, TestUninvertingReader, TestReloadAndDeleteDocs, SolrInfoBeanTest, TestZkChroot, HdfsCollectionsAPIDistributedZkTest, HighlighterTest, SpellCheckCollatorWithCollapseTest, JsonLoaderTest, TestSolrIndexConfig, TestPerFieldSimilarity, TestDistributedStatsComponentCardinality, ReplaceNodeNoTargetTest, TestPerFieldSimilarityWithDefaultOverride, TestTolerantUpdateProcessorCloud, CdcrRequestHandlerTest, TestDistribIDF, TestComputePlanAction, FastVectorHighlighterTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, TestFaceting, TestRecovery, TestReload, TestSolr4Spatial, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, BadIndexSchemaTest, TestSort, TestFiltering, BasicFunctionalityTest, TestLazyCores, TestIndexSearcher, SoftAutoCommitTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, DebugComponentTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, TestOmitPositions, XmlUpdateRequestHandlerTest, RequestHandlersTest, FieldAnalysisRequestHandlerTest, LoggingHandlerTest, TestCSVResponseWriter, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, TestLFUCache, TimeZoneUtilsTest, TestFastOutputStream, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, DistribCursorPagingTest, DistributedQueueTest, HttpPartitionTest, MoveReplicaHDFSFailoverTest, OverseerTaskQueueTest, RemoteQueryErrorTest, SharedFSAutoReplicaFailoverTest, SolrXmlInZkTest, TestCloudPseudoReturnFields, TestCloudRecovery, TestConfigSetsAPIExclusivity, TestDeleteCollectionOnDownNodes, TestLeaderElectionWithEmptyReplica, TestPullReplicaErrorHandling, TestTlogReplica, ConcurrentDeleteAndCreateCollectionTest, TestCollectionsAPIViaSolrCloudCluster, AutoAddReplicasIntegrationTest]
   [junit4] Completed [586/777 (3!)] on J1 in 145.77s, 1 test, 1 failure <<< FAILURES!

[...truncated 45021 lines...]

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build # 1401 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1401/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseG1GC

6 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest

Error Message:
9 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:     1) Thread[id=25586, name=zkCallback-7428-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    2) Thread[id=25410, name=zkConnectionManagerCallback-7429-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)         at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    3) Thread[id=25577, name=zkCallback-7428-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    4) Thread[id=25407, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10/java.lang.Thread.run(Thread.java:844)    5) Thread[id=25409, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)         at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    6) Thread[id=25609, name=zkCallback-7428-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    7) Thread[id=25412, name=zkCallback-7428-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    8) Thread[id=25562, name=zkCallback-7428-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    9) Thread[id=25408, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-SendThread(127.0.0.1:38809), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 9 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest: 
   1) Thread[id=25586, name=zkCallback-7428-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=25410, name=zkConnectionManagerCallback-7429-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
        at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=25577, name=zkCallback-7428-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=25407, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   5) Thread[id=25409, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
        at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   6) Thread[id=25609, name=zkCallback-7428-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   7) Thread[id=25412, name=zkCallback-7428-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   8) Thread[id=25562, name=zkCallback-7428-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   9) Thread[id=25408, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-SendThread(127.0.0.1:38809), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=25586, name=zkCallback-7428-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    2) Thread[id=25410, name=zkConnectionManagerCallback-7429-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)         at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    3) Thread[id=25577, name=zkCallback-7428-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    4) Thread[id=25609, name=zkCallback-7428-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    5) Thread[id=25412, name=zkCallback-7428-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    6) Thread[id=25562, name=zkCallback-7428-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10/java.lang.Thread.run(Thread.java:844)    7) Thread[id=25408, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-SendThread(127.0.0.1:38809), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]         at java.base@10/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=25586, name=zkCallback-7428-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=25410, name=zkConnectionManagerCallback-7429-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
        at java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=25577, name=zkCallback-7428-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=25609, name=zkCallback-7428-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   5) Thread[id=25412, name=zkCallback-7428-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   6) Thread[id=25562, name=zkCallback-7428-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   7) Thread[id=25408, name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[C7DEEB492DC5DC66]-SendThread(127.0.0.1:38809), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
        at java.base@10/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66]:0)


FAILED:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test

Error Message:
There were too many update fails (105 > 100) - we expect it can happen, but shouldn't easily

Stack Trace:
java.lang.AssertionError: There were too many update fails (105 > 100) - we expect it can happen, but shouldn't easily
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66:4F8AD4938339B19E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertFalse(Assert.java:68)
	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test(ChaosMonkeyNothingIsSafeWithPullReplicasTest.java:263)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader

Error Message:
Address already in use

Stack Trace:
java.net.BindException: Address already in use
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66:2149DF8914472507]:0)
	at java.base/sun.nio.ch.Net.bind0(Native Method)
	at java.base/sun.nio.ch.Net.bind(Net.java:433)
	at java.base/sun.nio.ch.Net.bind(Net.java:425)
	at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:225)
	at java.base/sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:334)
	at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:302)
	at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
	at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:238)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
	at org.eclipse.jetty.server.Server.doStart(Server.java:397)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:396)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:369)
	at org.apache.solr.cloud.ForceLeaderTest.bringBackOldLeaderAndSendDoc(ForceLeaderTest.java:508)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:301)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66:4F8AD4938339B19E]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([C7DEEB492DC5DC66:7DD2DCC6722D0A29]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.junit.Assert.assertNull(Assert.java:562)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1585)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12832 lines...]
   [junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/init-core-data-001
   [junit4]   2> 841054 WARN  (SUITE-ForceLeaderTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=238 numCloses=238
   [junit4]   2> 841054 INFO  (SUITE-ForceLeaderTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 841055 INFO  (SUITE-ForceLeaderTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
   [junit4]   2> 841055 INFO  (SUITE-ForceLeaderTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 841055 INFO  (SUITE-ForceLeaderTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /psj/z
   [junit4]   2> 841057 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 841062 INFO  (Thread-1312) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 841062 INFO  (Thread-1312) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 841063 ERROR (Thread-1312) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 841162 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.ZkTestServer start zk server on port:46811
   [junit4]   2> 841163 INFO  (zkConnectionManagerCallback-5205-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841165 INFO  (zkConnectionManagerCallback-5207-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841167 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 841168 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 841169 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 841169 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 841169 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 841170 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 841170 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 841171 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 841171 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 841172 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 841172 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 841173 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 841250 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 841250 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 841251 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 841251 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 841251 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e2052e7{/psj/z,null,AVAILABLE}
   [junit4]   2> 841251 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3066c6ac{HTTP/1.1,[http/1.1]}{127.0.0.1:٣٨٨٢٣}
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.Server Started @٨٤٣٣٢٢ms
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/psj/z, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/tempDir-001/control/data, hostPort=44155, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/control-001/cores, replicaType=NRT}
   [junit4]   2> 841252 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 841252 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T14:57:50.726441Z
   [junit4]   2> 841253 INFO  (zkConnectionManagerCallback-5209-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841254 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 841254 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/control-001/solr.xml
   [junit4]   2> 841256 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 841256 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 841257 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 841258 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46811/solr
   [junit4]   2> 841259 INFO  (zkConnectionManagerCallback-5213-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841260 INFO  (zkConnectionManagerCallback-5215-thread-1-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841296 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 841296 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44155_psj%2Fz
   [junit4]   2> 841296 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.Overseer Overseer (id=72187894743040004-127.0.0.1:44155_psj%2Fz-n_0000000000) starting
   [junit4]   2> 841300 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44155_psj%2Fz
   [junit4]   2> 841307 INFO  (zkCallback-5214-thread-1-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 841337 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 841343 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 841343 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 841344 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/control-001/cores
   [junit4]   2> 841373 INFO  (zkConnectionManagerCallback-5221-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 841374 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 841374 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46811/solr ready
   [junit4]   2> 841375 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40190,localport=44155], receiveBufferSize:531000
   [junit4]   2> 841375 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38823,localport=52240], receiveBufferSize=530904
   [junit4]   2> 841376 INFO  (qtp1801354488-13353) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44155_psj%252Fz&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 841378 INFO  (OverseerThreadFactory-2754-thread-1-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 841482 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40202,localport=44155], receiveBufferSize:531000
   [junit4]   2> 841484 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38823,localport=52252], receiveBufferSize=530904
   [junit4]   2> 841487 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 841487 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 841591 INFO  (zkCallback-5214-thread-1-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 842550 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 842571 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 842698 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 842722 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 842722 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 842722 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 842722 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 842724 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8717043910990985]
   [junit4]   2> 842731 WARN  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 842776 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 842776 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 842785 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 842785 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 842787 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1795463673, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 842787 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@60b2d484[control_collection_shard1_replica_n1] main]
   [junit4]   2> 842800 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 842801 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 842801 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 842802 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593022949386878976
   [junit4]   2> 842804 INFO  (searcherExecutor-2757-thread-1-processing-n:127.0.0.1:44155_psj%2Fz x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@60b2d484[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 842807 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 842808 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 842808 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44155/psj/z/control_collection_shard1_replica_n1/
   [junit4]   2> 842808 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 842808 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44155/psj/z/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 842808 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 842810 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44155/psj/z/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 842911 INFO  (zkCallback-5214-thread-2-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 842961 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 843008 INFO  (qtp1801354488-13393) [n:127.0.0.1:44155_psj%2Fz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1521
   [junit4]   2> 843010 INFO  (qtp1801354488-13353) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 843063 INFO  (zkCallback-5214-thread-2-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 843379 INFO  (OverseerCollectionConfigSetProcessor-72187894743040004-127.0.0.1:44155_psj%2Fz-n_0000000000) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 844010 INFO  (qtp1801354488-13353) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44155_psj%252Fz&wt=javabin&version=2} status=0 QTime=2634
   [junit4]   2> 844014 INFO  (zkConnectionManagerCallback-5225-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844015 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 844016 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46811/solr ready
   [junit4]   2> 844016 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 844016 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40212,localport=44155], receiveBufferSize:531000
   [junit4]   2> 844020 INFO  (SocketProxy-Acceptor-44155) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38823,localport=52262], receiveBufferSize=530904
   [junit4]   2> 844021 INFO  (qtp1801354488-13394) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 844022 INFO  (OverseerThreadFactory-2754-thread-2-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 844022 WARN  (OverseerThreadFactory-2754-thread-2-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 844225 INFO  (qtp1801354488-13394) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 844225 INFO  (qtp1801354488-13394) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 844300 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001 of type NRT
   [junit4]   2> 844301 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 844302 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 844302 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 844302 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 844302 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d008599{/psj/z,null,AVAILABLE}
   [junit4]   2> 844302 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@125804e4{HTTP/1.1,[http/1.1]}{127.0.0.1:٤٢٠٩١}
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.e.j.s.Server Started @٨٤٦٣٧٣ms
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/psj/z, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/tempDir-001/jetty1, hostPort=42337, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001/cores}
   [junit4]   2> 844303 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 844303 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T14:57:53.777362Z
   [junit4]   2> 844304 INFO  (zkConnectionManagerCallback-5227-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844305 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 844305 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001/solr.xml
   [junit4]   2> 844307 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 844307 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 844307 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 844314 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46811/solr
   [junit4]   2> 844315 INFO  (zkConnectionManagerCallback-5231-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844320 INFO  (zkConnectionManagerCallback-5233-thread-1-processing-n:127.0.0.1:42337_psj%2Fz) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844323 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 844324 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 844324 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42337_psj%2Fz
   [junit4]   2> 844325 INFO  (zkCallback-5214-thread-2-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 844325 INFO  (zkCallback-5232-thread-1-processing-n:127.0.0.1:42337_psj%2Fz) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 844325 INFO  (zkCallback-5224-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 844358 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 844370 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 844370 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 844372 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[C7DEEB492DC5DC66]) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001/cores
   [junit4]   2> 844388 INFO  (SocketProxy-Acceptor-42337) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=55092,localport=42337], receiveBufferSize:531000
   [junit4]   2> 844388 INFO  (SocketProxy-Acceptor-42337) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=42091,localport=54562], receiveBufferSize=530904
   [junit4]   2> 844389 INFO  (qtp1919171283-13412) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:42337_psj%252Fz&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 844390 INFO  (OverseerCollectionConfigSetProcessor-72187894743040004-127.0.0.1:44155_psj%2Fz-n_0000000000) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 844390 INFO  (OverseerThreadFactory-2754-thread-3-processing-n:127.0.0.1:44155_psj%2Fz) [n:127.0.0.1:44155_psj%2Fz    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:42337_psj%2Fz for creating new replica
   [junit4]   2> 844391 INFO  (SocketProxy-Acceptor-42337) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=55096,localport=42337], receiveBufferSize:531000
   [junit4]   2> 844391 INFO  (SocketProxy-Acceptor-42337) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=42091,localport=54566], receiveBufferSize=530904
   [junit4]   2> 844392 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 844392 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 844494 INFO  (zkCallback-5232-thread-1-processing-n:127.0.0.1:42337_psj%2Fz) [n:127.0.0.1:42337_psj%2Fz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 845430 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 845437 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 845496 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 845505 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 845506 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d07d841
   [junit4]   2> 845506 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 845506 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_C7DEEB492DC5DC66-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 845507 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8717043910990985]
   [junit4]   2> 845509 WARN  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 845534 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 845534 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 845536 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 845536 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 845537 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1795463673, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 845537 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ffc842d[collection1_shard2_replica_n41] main]
   [junit4]   2> 845538 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 845538 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 845539 INFO  (qtp1919171283-13418) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 845539 INFO  (searcherExecutor-2768-thread-1-processing-n:127.0.0.1:42337_psj%2Fz x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:42337_psj%2Fz c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@6ffc842d[collection1_shard2_replica_n41

[...truncated too long message...]

ger s:shard1 r:core_node8 x:testMetricTrigger_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testMetricTrigger.shard1.replica_n7, tag=784968972
   [junit4]   2> 860596 INFO  (coreCloseExecutor-1087-thread-1) [n:127.0.0.1:46583_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@33947157: rootName = solr_46583, domain = solr.core.collection1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@4f06384b
   [junit4]   2> 860596 INFO  (coreCloseExecutor-1088-thread-1) [n:127.0.0.1:44173_solr c:testMetricTrigger s:shard1 r:core_node8 x:testMetricTrigger_shard1_replica_n7] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28e50669: rootName = solr_44173, domain = solr.core.testMetricTrigger.shard1.replica_n7, service url = null, agent id = null] for registry solr.core.testMetricTrigger.shard1.replica_n7 / com.codahale.metrics.MetricRegistry@3026c356
   [junit4]   2> 860606 INFO  (coreCloseExecutor-1084-thread-1) [n:127.0.0.1:34297_solr c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=513810133
   [junit4]   2> 860607 INFO  (coreCloseExecutor-1083-thread-1) [n:127.0.0.1:35519_solr c:testMetricTrigger s:shard1 r:core_node6 x:testMetricTrigger_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testMetricTrigger.shard1.leader, tag=1911034231
   [junit4]   2> 860610 INFO  (coreCloseExecutor-1087-thread-1) [n:127.0.0.1:46583_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=2129611505
   [junit4]   2> 860611 INFO  (coreCloseExecutor-1088-thread-1) [n:127.0.0.1:44173_solr c:testMetricTrigger s:shard1 r:core_node8 x:testMetricTrigger_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testMetricTrigger.shard1.leader, tag=784968972
   [junit4]   2> 860612 INFO  (coreCloseExecutor-1089-thread-1) [n:127.0.0.1:42531_solr c:testMetricTrigger s:shard2 r:core_node4 x:testMetricTrigger_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testMetricTrigger.shard2.leader, tag=759980951
   [junit4]   2> 860619 INFO  (jetty-closer-631-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1414aeb2{/solr,null,UNAVAILABLE}
   [junit4]   2> 860620 INFO  (jetty-closer-631-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 860620 INFO  (jetty-closer-631-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72188119704993860-127.0.0.1:46583_solr-n_0000000021) closing
   [junit4]   2> 860621 INFO  (OverseerStateUpdate-72188119704993860-127.0.0.1:46583_solr-n_0000000021) [n:127.0.0.1:46583_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46583_solr
   [junit4]   2> 860621 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10076b660050050, likely client has closed socket
   [junit4]   2> 860622 INFO  (jetty-closer-631-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e0ebd6d{/solr,null,UNAVAILABLE}
   [junit4]   2> 860622 INFO  (jetty-closer-631-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 860622 WARN  (OverseerAutoScalingTriggerThread-72188119704993860-127.0.0.1:46583_solr-n_0000000021) [n:127.0.0.1:46583_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 860622 DEBUG (jetty-closer-631-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 860625 INFO  (jetty-closer-631-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@306f39f0{/solr,null,UNAVAILABLE}
   [junit4]   2> 860625 INFO  (jetty-closer-631-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 862122 INFO  (jetty-closer-631-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@45a1db6{/solr,null,UNAVAILABLE}
   [junit4]   2> 862122 INFO  (jetty-closer-631-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a8ef13c{/solr,null,UNAVAILABLE}
   [junit4]   2> 862122 INFO  (jetty-closer-631-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 862123 INFO  (jetty-closer-631-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 862123 ERROR (SUITE-TriggerIntegrationTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 862123 INFO  (SUITE-TriggerIntegrationTest-seed#[C7DEEB492DC5DC66]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45281 45281
   [junit4]   2> 877172 INFO  (Thread-607) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45281 45281
   [junit4]   2> 877173 WARN  (Thread-607) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	30	/solr/aliases.json
   [junit4]   2> 	29	/solr/security.json
   [junit4]   2> 	21	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	10	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	9	/solr/configs/conf
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	61	/solr/collections/collection1/state.json
   [junit4]   2> 	36	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	30	/solr/clusterprops.json
   [junit4]   2> 	30	/solr/clusterstate.json
   [junit4]   2> 	20	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/collection1/leader_elect/shard1/election/72188119704993860-core_node3-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/72188119704993860-127.0.0.1:46583_solr-n_0000000021
   [junit4]   2> 	2	/solr/overseer_elect/election/72188119704993863-127.0.0.1:34297_solr-n_0000000022
   [junit4]   2> 	2	/solr/overseer_elect/election/72188119704993875-127.0.0.1:42531_solr-n_0000000026
   [junit4]   2> 	2	/solr/overseer_elect/election/72188119704993842-127.0.0.1:41373_solr-n_0000000015
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	30	/solr/live_nodes
   [junit4]   2> 	30	/solr/collections
   [junit4]   2> 	20	/solr/overseer/queue-work
   [junit4]   2> 	20	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	20	/solr/overseer/queue
   [junit4]   2> 	20	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_C7DEEB492DC5DC66-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=MockRandom), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), x_s=PostingsFormat(name=MockRandom)}, docValues:{_version_=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1068, maxMBSortInHeap=6.743397933690327, sim=RandomSimilarity(queryNorm=false): {}, locale=en-AS, timezone=SystemV/YST9
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=113907016,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ChaosMonkeyNothingIsSafeWithPullReplicasTest, ForceLeaderTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TriggerIntegrationTest, TriggerIntegrationTest]
   [junit4] Completed [19/20 (4!)] on J0 in 296.56s, 14 tests, 1 failure <<< FAILURES!

[...truncated 21 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 20 suites, 100 tests, 4 failures, 5 ignored [seed: C7DEEB492DC5DC66]

Total time: 15 minutes 41 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[repro]   0/5 failed: org.apache.solr.cloud.ForceLeaderTest
[repro]   0/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro]   4/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] git checkout a42e4b36f106f6e0e609127b7956e02bb8aa4cfa
HEAD is now at a42e4b3... SOLR-12006: Add a '*_t' and '*_t_sort' dynamic field for single valued text fields
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
+ rm -f /tmp/tmp.jFyS8aTFvW
Archiving artifacts
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a42e4b36f106f6e0e609127b7956e02bb8aa4cfa, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1400
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_162) - Build # 1400 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1400/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([4068533799FEB33:69FA21CEC3D71434]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:310)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12633 lines...]
   [junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
   [junit4]   2> 579943 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/init-core-data-001
   [junit4]   2> 579944 WARN  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 579944 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 579946 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 579947 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001
   [junit4]   2> 579947 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 579947 INFO  (Thread-1187) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 579947 INFO  (Thread-1187) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 579948 ERROR (Thread-1187) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 580047 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34687
   [junit4]   2> 580049 INFO  (zkConnectionManagerCallback-1241-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580053 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 580053 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 580053 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 580054 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 580069 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 580069 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 580069 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 580073 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40f02cd0{/solr,null,AVAILABLE}
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@30010431{SSL,[ssl, http/1.1]}{127.0.0.1:35753}
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-3) [    ] o.e.j.s.Server Started @581836ms
   [junit4]   2> 580077 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35753}
   [junit4]   2> 580078 ERROR (jetty-launcher-1238-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 580078 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 580078 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 580078 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 580078 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T10:40:05.015Z
   [junit4]   2> 580080 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 580080 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 580080 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bba53dc{/solr,null,AVAILABLE}
   [junit4]   2> 580080 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1c570e61{SSL,[ssl, http/1.1]}{127.0.0.1:38481}
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-2) [    ] o.e.j.s.Server Started @581840ms
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38481}
   [junit4]   2> 580081 INFO  (zkConnectionManagerCallback-1243-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f401068{/solr,null,AVAILABLE}
   [junit4]   2> 580081 ERROR (jetty-launcher-1238-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 580081 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T10:40:05.019Z
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e04b826{/solr,null,AVAILABLE}
   [junit4]   2> 580082 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@68883186{SSL,[ssl, http/1.1]}{127.0.0.1:33729}
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.e.j.s.Server Started @581841ms
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33729}
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1d47e155{SSL,[ssl, http/1.1]}{127.0.0.1:43091}
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.e.j.s.Server Started @581841ms
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43091}
   [junit4]   2> 580083 ERROR (jetty-launcher-1238-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 580083 ERROR (jetty-launcher-1238-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 580083 INFO  (zkConnectionManagerCallback-1245-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T10:40:05.020Z
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T10:40:05.020Z
   [junit4]   2> 580083 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 580093 INFO  (zkConnectionManagerCallback-1248-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580094 INFO  (zkConnectionManagerCallback-1249-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580094 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 580094 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 580095 INFO  (jetty-launcher-1238-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34687/solr
   [junit4]   2> 580095 INFO  (jetty-launcher-1238-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34687/solr
   [junit4]   2> 580105 INFO  (zkConnectionManagerCallback-1257-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580105 INFO  (zkConnectionManagerCallback-1255-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580106 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007596028a0005, likely client has closed socket
   [junit4]   2> 580107 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007596028a0004, likely client has closed socket
   [junit4]   2> 580110 INFO  (zkConnectionManagerCallback-1261-thread-1-processing-n:127.0.0.1:38481_solr) [n:127.0.0.1:38481_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580110 INFO  (zkConnectionManagerCallback-1260-thread-1-processing-n:127.0.0.1:35753_solr) [n:127.0.0.1:35753_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580111 INFO  (jetty-launcher-1238-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34687/solr
   [junit4]   2> 580113 INFO  (jetty-launcher-1238-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34687/solr
   [junit4]   2> 580114 INFO  (zkConnectionManagerCallback-1266-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580115 INFO  (zkConnectionManagerCallback-1271-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580115 INFO  (zkConnectionManagerCallback-1273-thread-1-processing-n:127.0.0.1:33729_solr) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580116 INFO  (zkConnectionManagerCallback-1275-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580121 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 580121 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43091_solr
   [junit4]   2> 580122 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer Overseer (id=72186881186070540-127.0.0.1:43091_solr-n_0000000000) starting
   [junit4]   2> 580125 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 580125 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43091_solr
   [junit4]   2> 580126 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 580126 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 580127 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 580127 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:43091_solr]
   [junit4]   2> 580127 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 580127 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 580129 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 580129 DEBUG (OverseerAutoScalingTriggerThread-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 580129 DEBUG (ScheduledTrigger-2064-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 580146 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 580147 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 580147 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 580148 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 580148 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 580148 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 580148 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33729_solr
   [junit4]   2> 580149 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38481_solr
   [junit4]   2> 580149 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33729_solr"} current state version: 0
   [junit4]   2> 580149 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33729_solr
   [junit4]   2> 580149 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 580149 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38481_solr"} current state version: 0
   [junit4]   2> 580149 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:38481_solr
   [junit4]   2> 580154 INFO  (zkCallback-1258-thread-1-processing-n:127.0.0.1:38481_solr) [n:127.0.0.1:38481_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 580154 INFO  (zkCallback-1259-thread-1-processing-n:127.0.0.1:35753_solr) [n:127.0.0.1:35753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 580155 INFO  (zkCallback-1272-thread-1-processing-n:127.0.0.1:33729_solr) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 580155 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35753_solr
   [junit4]   2> 580155 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35753_solr"} current state version: 0
   [junit4]   2> 580156 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35753_solr
   [junit4]   2> 580156 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 580157 INFO  (zkCallback-1258-thread-1-processing-n:127.0.0.1:38481_solr) [n:127.0.0.1:38481_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 580157 INFO  (zkCallback-1272-thread-1-processing-n:127.0.0.1:33729_solr) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 580157 INFO  (zkCallback-1259-thread-1-processing-n:127.0.0.1:35753_solr) [n:127.0.0.1:35753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 580172 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43091.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580189 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43091.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580189 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43091.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580190 INFO  (jetty-launcher-1238-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node1/.
   [junit4]   2> 580192 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38481.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580193 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580196 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35753.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580197 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38481.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580197 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38481.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580198 INFO  (jetty-launcher-1238-thread-2) [n:127.0.0.1:38481_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node2/.
   [junit4]   2> 580200 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580201 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580201 INFO  (jetty-launcher-1238-thread-4) [n:127.0.0.1:33729_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node4/.
   [junit4]   2> 580203 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35753.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580203 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35753.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 580203 INFO  (jetty-launcher-1238-thread-3) [n:127.0.0.1:35753_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node3/.
   [junit4]   2> 580303 INFO  (zkConnectionManagerCallback-1283-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580305 INFO  (zkConnectionManagerCallback-1287-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 580306 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 580307 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34687/solr ready
   [junit4]   2> 580322 INFO  (qtp482477522-5411) [n:127.0.0.1:33729_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43091_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 580325 INFO  (OverseerThreadFactory-2066-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 580328 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":".system",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "numShards":1,
   [junit4]   2>   "createNodeSet":"127.0.0.1:43091_solr",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 580328 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 580328 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/.system/state.json
   [junit4]   2> 580430 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 580430 INFO  (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 580430 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 580431 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 580531 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 0
   [junit4]   2> 580657 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 580657 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 580659 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 580659 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 580659 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:43091/solr","node_name":"127.0.0.1:43091_solr","state":"down","type":"NRT"}
   [junit4]   2> 580659 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>           "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 580760 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 1
   [junit4]   2> 580760 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 580760 INFO  (zkCallback-1274-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 581130 DEBUG (ScheduledTrigger-2064-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 581682 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 581685 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 581687 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 581691 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 581692 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 581692 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 581693 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 581693 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43091.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fd03da6
   [junit4]   2> 581693 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 581693 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node1/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
   [junit4]   2> 581770 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 581770 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 581771 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs 
   [junit4]   2> 581771 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 581773 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6510b074[.system_shard1_replica_n1] main]
   [junit4]   2> 581773 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 581773 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 581774 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 581774 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 581774 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 581775 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593006732567642112
   [junit4]   2> 581777 INFO  (searcherExecutor-2075-thread-1-processing-n:127.0.0.1:43091_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node2) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@6510b074[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 581780 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 581780 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 581781 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:43091/solr/.system_shard1_replica_n1/
   [junit4]   2> 581781 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 581781 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:43091/solr/.system_shard1_replica_n1/ has no replicas
   [junit4]   2> 581781 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 581782 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:43091/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 581782 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 581883 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 2
   [junit4]   2> 581885 INFO  (zkCallback-1274-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 581885 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 581933 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 581934 INFO  (qtp683236386-5416) [n:127.0.0.1:43091_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1277
   [junit4]   2> 581937 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 581937 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 581937 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:43091/solr","node_name":"127.0.0.1:43091_solr","state":"active","type":"NRT","leader":"true"}
   [junit4]   2> 581937 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/3)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:43091/solr",
   [junit4]   2>           "node_name":"127.0.0.1:43091_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true"}}}}}
   [junit4]   2> 581939 INFO  (qtp482477522-5411) [n:127.0.0.1:33729_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 582038 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 3
   [junit4]   2> 582038 INFO  (zkCallback-1274-thread-1-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 582038 INFO  (zkCallback-1274-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 582131 DEBUG (ScheduledTrigger-2064-thread-2) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 582329 INFO  (OverseerCollectionConfigSetProcessor-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 582940 INFO  (qtp482477522-5411) [n:127.0.0.1:33729_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43091_solr&wt=javabin&version=2} status=0 QTime=2618
   [junit4]   2> 582941 INFO  (qtp482477522-5414) [n:127.0.0.1:33729_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33729_solr,127.0.0.1:35753_solr,127.0.0.1:38481_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 582942 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 582943 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
   [junit4]   2> 582943 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 582944 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
   [junit4]   2> 582945 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
   [junit4]   2> 582945 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
   [junit4]   2> 582946 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 582947 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 582947 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 582948 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 582948 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 582949 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 582949 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 582950 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 582950 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 582951 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 582951 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 582952 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 582952 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 582953 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 582953 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 582963 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 582964 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 582965 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 582965 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 582966 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 582966 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 582967 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 582967 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 582968 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 582968 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 582969 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 582970 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 582970 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 582971 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 582971 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 582972 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 582972 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 582973 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 582974 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 582974 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 582975 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 582976 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 582976 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 582977 INFO  (OverseerThreadFactory-2066-thread-2-processing-n:127.0.0.1:43091_solr) [n:127.0.0.1:43091_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
   [junit4]   2> 582980 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:33729_solr,127.0.0.1:35753_solr,127.0.0.1:38481_solr",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 582980 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 583080 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 583131 DEBUG (ScheduledTrigger-2064-thread-1) [n:127.0.0.1:43091_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 583187 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 583187 INFO  (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 583190 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 583190 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 583191 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 583191 INFO  (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 583192 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 583192 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 583193 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 583193 INFO  (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 583193 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 583194 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>       "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 583294 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
   [junit4]   2> 583396 INFO  (qtp482477522-5400) [n:127.0.0.1:33729_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n3&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 583397 INFO  (qtp482477522-5400) [n:127.0.0.1:33729_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 583407 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>   "node_name":"127.0.0.1:33729_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 583407 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>   "node_name":"127.0.0.1:33729_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 583407 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3","base_url":"https://127.0.0.1:33729/solr","node_name":"127.0.0.1:33729_solr","state":"down","type":"NRT"}
   [junit4]   2> 583407 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>           "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>           "node_name":"127.0.0.1:33729_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 583422 INFO  (qtp150796232-5408) [n:127.0.0.1:38481_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 583422 INFO  (qtp2067541297-5401) [n:127.0.0.1:35753_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 583423 INFO  (qtp2067541297-5401) [n:127.0.0.1:35753_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 583423 INFO  (qtp150796232-5408) [n:127.0.0.1:38481_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 583426 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>   "node_name":"127.0.0.1:35753_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 583426 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>   "node_name":"127.0.0.1:35753_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 583426 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:35753/solr","node_name":"127.0.0.1:35753_solr","state":"down","type":"NRT"}
   [junit4]   2> 583426 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>           "node_name":"127.0.0.1:35753_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>           "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>           "node_name":"127.0.0.1:33729_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 583429 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node4",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>   "node_name":"127.0.0.1:38481_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 583429 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node4",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>   "node_name":"127.0.0.1:38481_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 583429 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:38481/solr","node_name":"127.0.0.1:38481_solr","state":"down","type":"NRT"}
   [junit4]   2> 583429 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:38481/solr",
   [junit4]   2>           "node_name":"127.0.0.1:38481_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:35753/solr",
   [junit4]   2>           "node_name":"127.0.0.1:35753_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>           "base_url":"https://127.0.0.1:33729/solr",
   [junit4]   2>           "node_name":"127.0.0.1:33729_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 583529 DEBUG (OverseerStateUpdate-72186881186070540-127.0.0.1:43091_solr-n_0000000000) [n:127.0.0.1:43091_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
   [junit4]   2> 583530 INFO  (zkCallback-1258-thread-1-processing-n:127.0.0.1:38481_solr) [n:127.0.0.1:38481_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 583530 INFO  (zkCallback-1259-thread-1-processing-n:127.0.0.1:35753_solr) [n:127.0.0.1:35753_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 583530 INFO  (zkCallback-1272-thread-1-processing-n:127.0.0.1:33729_solr) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 583530 INFO  (zkCallback-1272-thread-2-processing-n:127.0.0.1:33729_solr) [n:127.0.0.1:33729_solr    ] o.a.s.c.c.ZkStateReader A cluster state

[...truncated too long message...]

s.c.Overseer Overseer Loop exiting : 127.0.0.1:45297_solr
   [junit4]   2> 31029 WARN  (OverseerAutoScalingTriggerThread-72187068831694860-127.0.0.1:45297_solr-n_0000000000) [n:127.0.0.1:45297_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 31029 INFO  (coreCloseExecutor-65-thread-1) [n:127.0.0.1:37521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrCore [AutoscalingHistoryHandlerTest_collection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2523a456
   [junit4]   2> 31030 INFO  (coreCloseExecutor-65-thread-1) [n:127.0.0.1:37521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n1, tag=623092822
   [junit4]   2> 31030 INFO  (coreCloseExecutor-64-thread-1) [n:127.0.0.1:40851_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2012c8ec: rootName = solr_40851, domain = solr.core..system.shard1.replica_n3, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n3 / com.codahale.metrics.MetricRegistry@b143117
   [junit4]   2> 31030 INFO  (coreCloseExecutor-65-thread-1) [n:127.0.0.1:37521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@658f68c: rootName = solr_37521, domain = solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@23fd13d4
   [junit4]   2> 31030 DEBUG (jetty-closer-2-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 31031 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10075c1b317000c, likely client has closed socket
   [junit4]   2> 31032 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:37521_solr) [n:127.0.0.1:37521_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37521_solr
   [junit4]   2> 31034 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1925b928{/solr,null,UNAVAILABLE}
   [junit4]   2> 31034 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 31045 INFO  (coreCloseExecutor-64-thread-1) [n:127.0.0.1:40851_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=1203015930
   [junit4]   2> 31045 INFO  (coreCloseExecutor-62-thread-1) [n:127.0.0.1:34687_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=489774989
   [junit4]   2> 31046 INFO  (coreCloseExecutor-65-thread-1) [n:127.0.0.1:37521_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=623092822
   [junit4]   2> 31047 INFO  (coreCloseExecutor-63-thread-1) [n:127.0.0.1:37153_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=1496806561
   [junit4]   2> 31056 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10075c1b3170011, likely client has closed socket
   [junit4]   2> 31056 INFO  (jetty-closer-2-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2edd2bb2{/solr,null,UNAVAILABLE}
   [junit4]   2> 31056 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4bc71c7c{/solr,null,UNAVAILABLE}
   [junit4]   2> 31056 INFO  (jetty-closer-2-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 31056 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 32558 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@32821cdb{/solr,null,UNAVAILABLE}
   [junit4]   2> 32558 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e35b84{/solr,null,UNAVAILABLE}
   [junit4]   2> 32558 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 32558 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 32558 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 32559 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[4068533799FEB33]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34289 34289
   [junit4]   2> 37661 INFO  (Thread-1) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34289 34289
   [junit4]   2> 37662 WARN  (Thread-1) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	9	/solr/collections/AutoscalingHistoryHandlerTest_collection/terms/shard1
   [junit4]   2> 	6	/solr/collections/.system/terms/shard1
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/.system
   [junit4]   2> 	2	/solr/configs/.system/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 	15	/solr/collections/.system/state.json
   [junit4]   2> 	13	/solr/clusterprops.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	13	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_4068533799FEB33-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {action_s=FSTOrd50, event.source_s=PostingsFormat(name=Asserting), type=FSTOrd50, before.actions_ss=PostingsFormat(name=Asserting), event.property._enqueue_time__ss=FSTOrd50, after.actions_ss=BlockTreeOrds(blocksize=128), stage_s=FSTOrd50, event.id_s=Lucene50(blocksize=128), event.property.eventTimes_ss=FSTOrd50, source_s=Lucene50(blocksize=128), event.type_s=FSTOrd50, responses_ts=BlockTreeOrds(blocksize=128), id=Lucene50(blocksize=128), collections_ss=FSTOrd50, operations.params_ts=FSTOrd50, event.property.nodeNames_ss=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Memory), event.time_l=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=357, maxMBSortInHeap=6.815142484009092, sim=RandomSimilarity(queryNorm=true): {}, locale=es-MX, timezone=Europe/Gibraltar
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=378170616,total=513277952
   [junit4]   2> NOTE: All tests run in this JVM: [AutoscalingHistoryHandlerTest]
   [junit4] Completed [2/5 (2!)] on J2 in 38.55s, 1 test, 1 failure <<< FAILURES!

[...truncated 25 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 5 tests, 2 failures [seed: 4068533799FEB33]

Total time: 1 minute 24 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   2/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro] git checkout a42e4b36f106f6e0e609127b7956e02bb8aa4cfa
HEAD is now at a42e4b3... SOLR-12006: Add a '*_t' and '*_t_sort' dynamic field for single valued text fields
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
+ rm -f /tmp/tmp.DNYSAuhZXo
Archiving artifacts
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a42e4b36f106f6e0e609127b7956e02bb8aa4cfa, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1399
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1399 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1399/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test

Error Message:
Trigger was not fired 

Stack Trace:
java.lang.AssertionError: Trigger was not fired 
	at __randomizedtesting.SeedInfo.seed([80CBEE26A1715FDA:89FD1FC0F8D3222]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:151)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([80CBEE26A1715FDA:ED374ADB1B39A0DD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:310)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestUtilizeNode.test

Error Message:
no replica should be present in  127.0.0.1:38415_solr

Stack Trace:
java.lang.AssertionError: no replica should be present in  127.0.0.1:38415_solr
	at __randomizedtesting.SeedInfo.seed([80CBEE26A1715FDA:89FD1FC0F8D3222]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.TestUtilizeNode.test(TestUtilizeNode.java:99)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:38393_solr, 127.0.0.1:39645_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/17)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"testSimple1_shard1_replica_n1",           "base_url":"https://127.0.0.1:39645/solr",           "node_name":"127.0.0.1:39645_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node12":{           "core":"testSimple1_shard1_replica_n11",           "base_url":"https://127.0.0.1:39645/solr",           "node_name":"127.0.0.1:39645_solr",           "state":"active",           "type":"NRT"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node7":{           "core":"testSimple1_shard2_replica_n4",           "base_url":"https://127.0.0.1:39645/solr",           "node_name":"127.0.0.1:39645_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node10":{           "core":"testSimple1_shard2_replica_n9",           "base_url":"https://127.0.0.1:44737/solr",           "node_name":"127.0.0.1:44737_solr",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:38393_solr, 127.0.0.1:39645_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/17)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"testSimple1_shard1_replica_n1",
          "base_url":"https://127.0.0.1:39645/solr",
          "node_name":"127.0.0.1:39645_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node12":{
          "core":"testSimple1_shard1_replica_n11",
          "base_url":"https://127.0.0.1:39645/solr",
          "node_name":"127.0.0.1:39645_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "core":"testSimple1_shard2_replica_n4",
          "base_url":"https://127.0.0.1:39645/solr",
          "node_name":"127.0.0.1:39645_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node10":{
          "core":"testSimple1_shard2_replica_n9",
          "base_url":"https://127.0.0.1:44737/solr",
          "node_name":"127.0.0.1:44737_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([80CBEE26A1715FDA:B878CAD886828B0B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12160 lines...]
   [junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
   [junit4]   2> 143310 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/init-core-data-001
   [junit4]   2> 143312 WARN  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
   [junit4]   2> 143312 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 143314 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 143316 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001
   [junit4]   2> 143316 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 143317 INFO  (Thread-246) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 143317 INFO  (Thread-246) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 143318 ERROR (Thread-246) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 143417 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42513
   [junit4]   2> 143422 INFO  (zkConnectionManagerCallback-160-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143426 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 143428 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 143429 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 143437 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 143442 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 143442 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 143442 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 143442 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c00074{/solr,null,AVAILABLE}
   [junit4]   2> 143444 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1be7224{SSL,[ssl, http/1.1]}{127.0.0.1:33963}
   [junit4]   2> 143444 INFO  (jetty-launcher-157-thread-1) [    ] o.e.j.s.Server Started @145598ms
   [junit4]   2> 143444 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33963}
   [junit4]   2> 143444 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 143444 ERROR (jetty-launcher-157-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 143444 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 143445 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 143445 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 143445 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 143445 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T06:19:00.458Z
   [junit4]   2> 143445 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 143453 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 143453 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 143453 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 143456 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 143456 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 143456 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18a7c58{/solr,null,AVAILABLE}
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28d46d{/solr,null,AVAILABLE}
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@17321c9{SSL,[ssl, http/1.1]}{127.0.0.1:37353}
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-3) [    ] o.e.j.s.Server Started @145611ms
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37353}
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@f06791{SSL,[ssl, http/1.1]}{127.0.0.1:36031}
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-4) [    ] o.e.j.s.Server Started @145611ms
   [junit4]   2> 143457 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36031}
   [junit4]   2> 143458 ERROR (jetty-launcher-157-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 143458 ERROR (jetty-launcher-157-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T06:19:00.471Z
   [junit4]   2> 143458 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T06:19:00.471Z
   [junit4]   2> 143459 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@93b590{/solr,null,AVAILABLE}
   [junit4]   2> 143477 INFO  (zkConnectionManagerCallback-166-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143477 INFO  (zkConnectionManagerCallback-162-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143477 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 143477 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 143477 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@e65965{SSL,[ssl, http/1.1]}{127.0.0.1:44427}
   [junit4]   2> 143477 INFO  (jetty-launcher-157-thread-2) [    ] o.e.j.s.Server Started @145631ms
   [junit4]   2> 143477 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44427}
   [junit4]   2> 143478 ERROR (jetty-launcher-157-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 143478 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 143478 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 143478 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 143478 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T06:19:00.491Z
   [junit4]   2> 143481 INFO  (zkConnectionManagerCallback-165-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143483 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 143484 INFO  (zkConnectionManagerCallback-168-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143485 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 143491 INFO  (jetty-launcher-157-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42513/solr
   [junit4]   2> 143498 INFO  (jetty-launcher-157-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42513/solr
   [junit4]   2> 143499 INFO  (jetty-launcher-157-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42513/solr
   [junit4]   2> 143500 INFO  (zkConnectionManagerCallback-172-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143502 INFO  (zkConnectionManagerCallback-180-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143502 INFO  (jetty-launcher-157-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42513/solr
   [junit4]   2> 143502 INFO  (zkConnectionManagerCallback-178-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143509 INFO  (zkConnectionManagerCallback-184-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143512 INFO  (zkConnectionManagerCallback-186-thread-1-processing-n:127.0.0.1:37353_solr) [n:127.0.0.1:37353_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143516 INFO  (zkConnectionManagerCallback-188-thread-1-processing-n:127.0.0.1:33963_solr) [n:127.0.0.1:33963_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143521 INFO  (zkConnectionManagerCallback-190-thread-1-processing-n:127.0.0.1:36031_solr) [n:127.0.0.1:36031_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143522 INFO  (zkConnectionManagerCallback-192-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 143538 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 143539 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44427_solr
   [junit4]   2> 143541 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer Overseer (id=72185854593859596-127.0.0.1:44427_solr-n_0000000000) starting
   [junit4]   2> 143564 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 143578 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44427_solr
   [junit4]   2> 143579 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 143590 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 143590 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 143626 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44427_solr]
   [junit4]   2> 143626 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 143626 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 143649 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 143651 DEBUG (OverseerAutoScalingTriggerThread-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 143653 DEBUG (ScheduledTrigger-509-thread-1) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 143665 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 143669 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 143671 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37353_solr
   [junit4]   2> 143672 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37353_solr"} current state version: 0
   [junit4]   2> 143672 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:37353_solr
   [junit4]   2> 143673 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 143677 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 143681 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 143682 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 143688 INFO  (zkCallback-185-thread-1-processing-n:127.0.0.1:37353_solr) [n:127.0.0.1:37353_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 143690 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 143691 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:36031_solr"} current state version: 0
   [junit4]   2> 143691 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36031_solr
   [junit4]   2> 143691 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:36031_solr
   [junit4]   2> 143691 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 143692 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33963_solr
   [junit4]   2> 143692 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33963_solr"} current state version: 0
   [junit4]   2> 143692 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33963_solr
   [junit4]   2> 143692 INFO  (zkCallback-185-thread-1-processing-n:127.0.0.1:37353_solr) [n:127.0.0.1:37353_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 143692 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 143727 INFO  (zkCallback-189-thread-1-processing-n:127.0.0.1:36031_solr) [n:127.0.0.1:36031_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 143747 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33963_solr) [n:127.0.0.1:33963_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 144170 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37353.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144186 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36031.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144188 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37353.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144188 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37353.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144206 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33963.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144218 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44427.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144219 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36031.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144220 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36031.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144225 INFO  (jetty-launcher-157-thread-3) [n:127.0.0.1:37353_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node3/.
   [junit4]   2> 144227 INFO  (jetty-launcher-157-thread-4) [n:127.0.0.1:36031_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node4/.
   [junit4]   2> 144230 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44427.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144231 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44427.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144232 INFO  (jetty-launcher-157-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node2/.
   [junit4]   2> 144235 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33963.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144235 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33963.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 144236 INFO  (jetty-launcher-157-thread-1) [n:127.0.0.1:33963_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node1/.
   [junit4]   2> 144537 INFO  (zkConnectionManagerCallback-202-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 144549 INFO  (zkConnectionManagerCallback-206-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 144550 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 144550 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42513/solr ready
   [junit4]   2> 144626 INFO  (qtp7263692-912) [n:127.0.0.1:37353_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44427_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 144632 INFO  (OverseerThreadFactory-511-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 144652 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":".system",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "numShards":1,
   [junit4]   2>   "createNodeSet":"127.0.0.1:44427_solr",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 144652 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 144652 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/.system/state.json
   [junit4]   2> 144655 DEBUG (ScheduledTrigger-509-thread-1) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 144761 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 144761 INFO  (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 144762 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 144762 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 144863 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 0
   [junit4]   2> 145025 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 145025 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 145037 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 145037 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 145037 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:44427/solr","node_name":"127.0.0.1:44427_solr","state":"down","type":"NRT"}
   [junit4]   2> 145037 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>           "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 145141 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 1
   [junit4]   2> 145145 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 145154 INFO  (zkCallback-191-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 145657 DEBUG (ScheduledTrigger-509-thread-2) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 146045 WARN  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
   [junit4]   2> 146047 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 146055 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 146060 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 146068 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 146075 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 146077 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 146077 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 146077 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44427.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@da4806
   [junit4]   2> 146078 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 146078 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
   [junit4]   2> 146133 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 146133 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 146135 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs 
   [junit4]   2> 146135 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 146137 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6d49c0[.system_shard1_replica_n1] main]
   [junit4]   2> 146138 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 146138 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 146140 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 146142 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 146142 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 146144 INFO  (searcherExecutor-520-thread-1-processing-n:127.0.0.1:44427_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node2) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@6d49c0[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 146144 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592990308139794432
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44427/solr/.system_shard1_replica_n1/
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:44427/solr/.system_shard1_replica_n1/ has no replicas
   [junit4]   2> 146149 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 146154 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44427/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 146154 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 146255 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 2
   [junit4]   2> 146255 INFO  (zkCallback-191-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 146255 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 146305 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 146310 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 146310 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>   "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 146310 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:44427/solr","node_name":"127.0.0.1:44427_solr","state":"active","type":"NRT","leader":"true"}
   [junit4]   2> 146310 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/3)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:44427/solr",
   [junit4]   2>           "node_name":"127.0.0.1:44427_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true"}}}}}
   [junit4]   2> 146310 INFO  (qtp14784485-910) [n:127.0.0.1:44427_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1285
   [junit4]   2> 146314 INFO  (qtp7263692-912) [n:127.0.0.1:37353_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 146411 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 3
   [junit4]   2> 146411 INFO  (zkCallback-191-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 146411 INFO  (zkCallback-191-thread-1-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 146634 INFO  (OverseerCollectionConfigSetProcessor-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 146657 DEBUG (ScheduledTrigger-509-thread-1) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 147314 INFO  (qtp7263692-912) [n:127.0.0.1:37353_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44427_solr&wt=javabin&version=2} status=0 QTime=2688
   [junit4]   2> 147317 INFO  (qtp7263692-908) [n:127.0.0.1:37353_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37353_solr,127.0.0.1:33963_solr,127.0.0.1:36031_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 147319 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 147321 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
   [junit4]   2> 147322 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 147323 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
   [junit4]   2> 147324 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
   [junit4]   2> 147325 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
   [junit4]   2> 147326 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 147327 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 147328 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 147329 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 147330 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 147331 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 147332 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 147333 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 147333 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 147334 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 147335 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 147337 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 147338 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 147338 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 147339 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 147340 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 147341 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 147342 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 147343 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 147344 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 147345 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 147345 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 147346 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 147354 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 147356 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 147357 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 147358 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 147359 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 147360 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 147362 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 147363 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 147365 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 147368 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 147369 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 147369 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 147370 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 147374 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 147376 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 147377 INFO  (OverseerThreadFactory-511-thread-2-processing-n:127.0.0.1:44427_solr) [n:127.0.0.1:44427_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
   [junit4]   2> 147387 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:37353_solr,127.0.0.1:33963_solr,127.0.0.1:36031_solr",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 147387 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 147488 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 147607 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 147607 INFO  (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 147614 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 147614 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 147620 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33963/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 147620 INFO  (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33963/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 147621 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 147621 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node2":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>       "base_url":"https://127.0.0.1:33963/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 147624 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36031/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 147624 INFO  (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36031/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 147624 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node2":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>       "base_url":"https://127.0.0.1:33963/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 147625 DEBUG (OverseerStateUpdate-72185854593859596-127.0.0.1:44427_solr-n_0000000000) [n:127.0.0.1:44427_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node2":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:37353/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
   [junit4]   2>       "base_url":"https://127.0.0.1:33963/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2

[...truncated too long message...]

HandlerTest_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@8b306f: rootName = solr_39965, domain = solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7f3bcb
   [junit4]   2> 421636 INFO  (coreCloseExecutor-492-thread-1) [n:127.0.0.1:35319_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n4, tag=30250793
   [junit4]   2> 421636 INFO  (zkCallback-246-thread-3-processing-n:127.0.0.1:35319_solr) [n:127.0.0.1:35319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 421636 INFO  (coreCloseExecutor-492-thread-1) [n:127.0.0.1:35319_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ddc5c2: rootName = solr_35319, domain = solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n4, service url = null, agent id = null] for registry solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n4 / com.codahale.metrics.MetricRegistry@154cd51
   [junit4]   2> 421642 INFO  (coreCloseExecutor-490-thread-1) [n:127.0.0.1:38039_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=21668729
   [junit4]   2> 421645 INFO  (jetty-closer-221-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72186185624518665-127.0.0.1:38039_solr-n_0000000000) closing
   [junit4]   2> 421646 INFO  (OverseerStateUpdate-72186185624518665-127.0.0.1:38039_solr-n_0000000000) [n:127.0.0.1:38039_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38039_solr
   [junit4]   2> 421646 WARN  (OverseerAutoScalingTriggerThread-72186185624518665-127.0.0.1:38039_solr-n_0000000000) [n:127.0.0.1:38039_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 421646 DEBUG (jetty-closer-221-thread-2) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 421647 INFO  (zkCallback-252-thread-3-processing-n:127.0.0.1:39965_solr) [n:127.0.0.1:39965_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39965_solr
   [junit4]   2> 421647 INFO  (jetty-closer-221-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@90a3d1{/solr,null,UNAVAILABLE}
   [junit4]   2> 421647 INFO  (jetty-closer-221-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 421650 INFO  (coreCloseExecutor-491-thread-1) [n:127.0.0.1:41031_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=13142800
   [junit4]   2> 421654 INFO  (coreCloseExecutor-492-thread-1) [n:127.0.0.1:35319_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=30250793
   [junit4]   2> 421656 INFO  (jetty-closer-221-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a4a1d{/solr,null,UNAVAILABLE}
   [junit4]   2> 421656 INFO  (jetty-closer-221-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 421656 INFO  (coreCloseExecutor-493-thread-1) [n:127.0.0.1:39965_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=4046513
   [junit4]   2> 421658 INFO  (jetty-closer-221-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@92da93{/solr,null,UNAVAILABLE}
   [junit4]   2> 421658 INFO  (jetty-closer-221-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 421659 INFO  (jetty-closer-221-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1b21831{/solr,null,UNAVAILABLE}
   [junit4]   2> 421659 INFO  (jetty-closer-221-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 421659 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 421659 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[80CBEE26A1715FDA]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44469 44469
   [junit4]   2> 426766 INFO  (Thread-198) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44469 44469
   [junit4]   2> 426766 WARN  (Thread-198) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	9	/solr/collections/AutoscalingHistoryHandlerTest_collection/terms/shard1
   [junit4]   2> 	6	/solr/collections/.system/terms/shard1
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED
   [junit4]   2> 	2	/solr/configs/.system
   [junit4]   2> 	2	/solr/configs/.system/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 	13	/solr/clusterprops.json
   [junit4]   2> 	13	/solr/collections/.system/state.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72186185624518665-127.0.0.1:38039_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	13	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_80CBEE26A1715FDA-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {action_s=PostingsFormat(name=Memory), event.source_s=FST50, type=PostingsFormat(name=Memory), before.actions_ss=FST50, event.property._enqueue_time__ss=PostingsFormat(name=Memory), after.actions_ss=PostingsFormat(name=Direct), stage_s=PostingsFormat(name=Memory), event.id_s=Lucene50(blocksize=128), event.property.eventTimes_ss=PostingsFormat(name=Memory), source_s=Lucene50(blocksize=128), event.type_s=PostingsFormat(name=Memory), responses_ts=PostingsFormat(name=Direct), id=Lucene50(blocksize=128), collections_ss=PostingsFormat(name=Memory), operations.params_ts=PostingsFormat(name=Memory), event.property.nodeNames_ss=PostingsFormat(name=Memory)}, docValues:{_version_=DocValuesFormat(name=Lucene70), event.time_l=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1839, maxMBSortInHeap=5.054398298278489, sim=RandomSimilarity(queryNorm=true): {}, locale=sk, timezone=Etc/GMT-9
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=157326824,total=297533440
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtilizeNode, AutoAddReplicasIntegrationTest, AutoAddReplicasIntegrationTest, AutoscalingHistoryHandlerTest]
   [junit4] Completed [18/20 (4!)] on J0 in 54.50s, 1 test, 1 failure <<< FAILURES!

[...truncated 22 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 20 suites, 20 tests, 4 failures [seed: 80CBEE26A1715FDA]

Total time: 7 minutes 42 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestUtilizeNode
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
[repro]   1/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro]   3/5 failed: org.apache.solr.cloud.autoscaling.SystemLogListenerTest
[repro] git checkout a42e4b36f106f6e0e609127b7956e02bb8aa4cfa
HEAD is now at a42e4b3... SOLR-12006: Add a '*_t' and '*_t_sort' dynamic field for single valued text fields
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
+ rm -f /tmp/tmp.kpTAjClWCj
Archiving artifacts
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a42e4b36f106f6e0e609127b7956e02bb8aa4cfa, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1398
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1398 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1398/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseParallelGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.search.join.BlockJoinFacetDistribTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.search.join.BlockJoinFacetDistribTest:     1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.join.BlockJoinFacetDistribTest: 
   1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([FE37B6B8804C4D10]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.join.BlockJoinFacetDistribTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([FE37B6B8804C4D10]:0)


FAILED:  org.apache.lucene.index.TestStressNRT.test

Error Message:
MockDirectoryWrapper: cannot close: there are still 22 open files: {_9f.cfs=1, _9p.fdt=1, _9p_Asserting_0.tim=1, _9o.fdt=1, _9n.fdt=1, _9t.fdt=1, _9p_Asserting_0.doc=1, _9k_Asserting_0.tim=1, _9n_Asserting_0.tim=1, _9u.cfs=1, _9q_Asserting_0.tim=1, _9t_Asserting_0.tim=1, _9k.fdt=1, _9o_Asserting_0.doc=1, _9k_Asserting_0.doc=1, _9n_Asserting_0.doc=1, _9s.cfs=1, _9q_Asserting_0.doc=1, _9t_Asserting_0.doc=1, _9q.fdt=1, _96.cfs=1, _9o_Asserting_0.tim=1}

Stack Trace:
java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still 22 open files: {_9f.cfs=1, _9p.fdt=1, _9p_Asserting_0.tim=1, _9o.fdt=1, _9n.fdt=1, _9t.fdt=1, _9p_Asserting_0.doc=1, _9k_Asserting_0.tim=1, _9n_Asserting_0.tim=1, _9u.cfs=1, _9q_Asserting_0.tim=1, _9t_Asserting_0.tim=1, _9k.fdt=1, _9o_Asserting_0.doc=1, _9k_Asserting_0.doc=1, _9n_Asserting_0.doc=1, _9s.cfs=1, _9q_Asserting_0.doc=1, _9t_Asserting_0.doc=1, _9q.fdt=1, _96.cfs=1, _9o_Asserting_0.tim=1}
	at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:841)
	at org.apache.lucene.index.TestStressNRT.test(TestStressNRT.java:398)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: unclosed IndexInput: _9k_Asserting_0.tim
	at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:732)
	at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:776)
	at org.apache.lucene.codecs.blocktree.BlockTreeTermsReader.<init>(BlockTreeTermsReader.java:138)
	at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:445)
	at org.apache.lucene.codecs.asserting.AssertingPostingsFormat.fieldsProducer(AssertingPostingsFormat.java:58)
	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:112)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:78)
	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:208)
	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:258)
	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:105)
	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:490)
	at org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:293)
	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:268)
	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:258)
	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:140)
	at org.apache.lucene.index.TestStressNRT$1.run(TestStressNRT.java:160)




Build Log:
[...truncated 1111 lines...]
   [junit4] Suite: org.apache.lucene.index.TestStressNRT
   [junit4]   1> READER4: FAILED: unexpected exception
   [junit4]   1> java.lang.AssertionError: No documents or tombstones found for id 148, expected at least -55 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   1> 	at org.junit.Assert.fail(Assert.java:93)
   [junit4]   1> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)
   [junit4]   1> READER0: FAILED: unexpected exception
   [junit4]   1> java.lang.AssertionError: No documents or tombstones found for id 64, expected at least -61 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   1> 	at org.junit.Assert.fail(Assert.java:93)
   [junit4]   1> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)
   [junit4]   2> feb 21, 2018 3:16:24 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> ADVERTENCIA: Uncaught exception in thread: Thread[READER4,5,TGRP-TestStressNRT]
   [junit4]   2> java.lang.RuntimeException: java.lang.AssertionError: No documents or tombstones found for id 148, expected at least -55 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([1F4589E2D2DD0A22]:0)
   [junit4]   2> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:377)
   [junit4]   2> Caused by: java.lang.AssertionError: No documents or tombstones found for id 148, expected at least -55 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   2> 	at org.junit.Assert.fail(Assert.java:93)
   [junit4]   2> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)
   [junit4]   2> 
   [junit4]   2> feb 21, 2018 3:16:24 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> ADVERTENCIA: Uncaught exception in thread: Thread[READER0,5,TGRP-TestStressNRT]
   [junit4]   2> java.lang.RuntimeException: java.lang.AssertionError: No documents or tombstones found for id 64, expected at least -61 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([1F4589E2D2DD0A22]:0)
   [junit4]   2> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:377)
   [junit4]   2> Caused by: java.lang.AssertionError: No documents or tombstones found for id 64, expected at least -61 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]   2> 	at org.junit.Assert.fail(Assert.java:93)
   [junit4]   2> 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestStressNRT -Dtests.method=test -Dtests.seed=1F4589E2D2DD0A22 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-DO -Dtests.timezone=Europe/Budapest -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   1.36s J2 | TestStressNRT.test <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still 22 open files: {_9f.cfs=1, _9p.fdt=1, _9p_Asserting_0.tim=1, _9o.fdt=1, _9n.fdt=1, _9t.fdt=1, _9p_Asserting_0.doc=1, _9k_Asserting_0.tim=1, _9n_Asserting_0.tim=1, _9u.cfs=1, _9q_Asserting_0.tim=1, _9t_Asserting_0.tim=1, _9k.fdt=1, _9o_Asserting_0.doc=1, _9k_Asserting_0.doc=1, _9n_Asserting_0.doc=1, _9s.cfs=1, _9q_Asserting_0.doc=1, _9t_Asserting_0.doc=1, _9q.fdt=1, _96.cfs=1, _9o_Asserting_0.tim=1}
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:841)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT.test(TestStressNRT.java:398)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: unclosed IndexInput: _9k_Asserting_0.tim
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:732)
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:776)
   [junit4]    > 	at org.apache.lucene.codecs.blocktree.BlockTreeTermsReader.<init>(BlockTreeTermsReader.java:138)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:445)
   [junit4]    > 	at org.apache.lucene.codecs.asserting.AssertingPostingsFormat.fieldsProducer(AssertingPostingsFormat.java:58)
   [junit4]    > 	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
   [junit4]    > 	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
   [junit4]    > 	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:112)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:78)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:208)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:258)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:105)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:490)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:293)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:268)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:258)
   [junit4]    > 	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:140)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT$1.run(TestStressNRT.java:160)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3397, name=READER4, state=RUNNABLE, group=TGRP-TestStressNRT]
   [junit4]    > Caused by: java.lang.RuntimeException: java.lang.AssertionError: No documents or tombstones found for id 148, expected at least -55 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1F4589E2D2DD0A22]:0)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:377)
   [junit4]    > Caused by: java.lang.AssertionError: No documents or tombstones found for id 148, expected at least -55 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3393, name=READER0, state=RUNNABLE, group=TGRP-TestStressNRT]
   [junit4]    > Caused by: java.lang.RuntimeException: java.lang.AssertionError: No documents or tombstones found for id 64, expected at least -61 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1F4589E2D2DD0A22]:0)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:377)
   [junit4]    > Caused by: java.lang.AssertionError: No documents or tombstones found for id 64, expected at least -61 reader=StandardDirectoryReader(segments_1a:975:nrt _9f(7.3.0):c25/21:delGen=1 _96(7.3.0):c83/82:delGen=4 _9q(7.3.0):C96/63 _9k(7.3.0):C61/54:delGen=2 _9o(7.3.0):C24/16:delGen=1 _9n(7.3.0):C43/35:delGen=1 _9p(7.3.0):C3/2 _9s(7.3.0):c69/33:delGen=1 _9u(7.3.0):c55/26:delGen=1 _9t(7.3.0):C71/37:delGen=1)
   [junit4]    > 	at org.apache.lucene.index.TestStressNRT$2.run(TestStressNRT.java:348)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {id=DFR I(F)2}, locale=es-DO, timezone=Europe/Budapest
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=128265712,total=387973120
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimilarity2, Test2BNumericDocValues, TestTopDocsCollector, TestFixedLengthBytesRefArray, TestIndexWriterLockRelease, TestAttributeSource, TestRollingBuffer, TestSearchForDuplicates, TestSameTokenSamePosition, TestStressIndexing2, TestIndexingSequenceNumbers, TestFastCompressionMode, TestCloseableThreadLocal, TestPerFieldPostingsFormat2, TestIndexWriterReader, TestIndexSearcher, TestScorerPerf, TestPositiveScoresOnlyCollector, TestSimpleExplanationsOfNonMatches, TestLucene60PointsFormat, TestSpans, TestFutureObjects, TestUsageTrackingFilterCachingPolicy, TestMinShouldMatch2, TestShardSearching, TestFieldsReader, TestFilterWeight, TestFilterDirectory, TestCustomTermFreq, TestSynonymQuery, TestFilterDirectoryReader, TestTermRangeQuery, TestSpanNearQuery, TestOrdinalMap, TestBlockPostingsFormat, TestFieldInfos, TestRollingUpdates, TestDocValuesRewriteMethod, TestReaderClosed, TestRegexpQuery, TestIntroSelector, TestAllFilesDetectTruncation, TestDateSort, TestOfflineSorter, TestReaderWrapperDVTypeCheck, TestConjunctions, TestCollectionUtil, TestSearchWithThreads, TestMultiMMap, TestMultiFields, TestConsistentFieldNumbers, TestSimpleFSDirectory, TestLongRange, TestOperations, TestTermVectors, TestIndexCommit, TestSpanTermQuery, TestRoaringDocIdSet, TestAssertions, TestSimilarityBase, TestIndexWriterCommit, TestCachingTokenFilter, TestBoolean2ScorerSupplier, TestPackedInts, TestNRTReaderWithThreads, TestGraphTokenStreamFiniteStrings, TestDirectoryReader, TestMultiset, TestHighCompressionMode, TestPayloadsOnVectors, TestSpanBoostQuery, TestStressDeletes, TestStopFilter, TestManyFields, TestSetOnce, TestCompiledAutomaton, TestPrefixQuery, TestForUtil, TestIndexWriter, TestPerFieldDocValuesFormat, TestIndexWriterMerging, TestFSTs, TestBytesStore, TestAddIndexes, TestIndexWriterExceptions, TestSearcherManager, TestDeletionPolicy, TestBooleanOr, TestBasics, TestSloppyPhraseQuery, TestIndexWriterDelete, TestIndexWriterMergePolicy, TestNRTThreads, TestDuelingCodecs, TestPersistentSnapshotDeletionPolicy, TestStressAdvance, TestNorms, TestStandardAnalyzer, TestTieredMergePolicy, TestArrayUtil, TestBufferedIndexInput, TestWeakIdentityMap, TestComplexExplanations, TestRegexpRandom2, TestSegmentReader, TestTransactions, TestMultiThreadTermVectors, TestSegmentTermDocs, TestSimpleSearchEquivalence, TestHugeRamFile, TestTermsEnum2, TestDeterminizeLexicon, TestSpanExplanations, TestRAMDirectory, TestBagOfPostings, TestStressNRT]
   [junit4] Completed [268/466 (1!)] on J2 in 1.37s, 1 test, 1 error <<< FAILURES!

[...truncated 12041 lines...]
   [junit4] Suite: org.apache.solr.search.join.BlockJoinFacetDistribTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/init-core-data-001
   [junit4]   2> 1471027 WARN  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
   [junit4]   2> 1471028 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1471029 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1471029 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1471030 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001
   [junit4]   2> 1471030 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1471030 INFO  (Thread-3133) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1471030 INFO  (Thread-3133) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1471032 ERROR (Thread-3133) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1471130 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39885
   [junit4]   2> 1471133 INFO  (zkConnectionManagerCallback-2127-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471137 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471139 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471139 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471140 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471140 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471141 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471142 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1471142 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ad6af4{/solr,null,AVAILABLE}
   [junit4]   2> 1471142 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471142 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@67373b{/solr,null,AVAILABLE}
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@b0f535{HTTP/1.1,[http/1.1]}{127.0.0.1:33421}
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a97d{/solr,null,AVAILABLE}
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.e.j.s.Server Started @1473421ms
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33421}
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@17779ff{HTTP/1.1,[http/1.1]}{127.0.0.1:39175}
   [junit4]   2> 1471143 ERROR (jetty-launcher-2124-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@ab5510{HTTP/1.1,[http/1.1]}{127.0.0.1:36437}
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.107Z
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-3) [    ] o.e.j.s.Server Started @1473421ms
   [junit4]   2> 1471143 INFO  (jetty-launcher-2124-thread-1) [    ] o.e.j.s.Server Started @1473421ms
   [junit4]   2> 1471144 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36437}
   [junit4]   2> 1471144 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39175}
   [junit4]   2> 1471144 ERROR (jetty-launcher-2124-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471144 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471144 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471144 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471145 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.109Z
   [junit4]   2> 1471145 INFO  (zkConnectionManagerCallback-2129-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471144 ERROR (jetty-launcher-2124-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471145 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471145 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471145 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471145 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.109Z
   [junit4]   2> 1471146 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471146 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471146 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471146 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1471146 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9b2a51{/solr,null,AVAILABLE}
   [junit4]   2> 1471147 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@c91788{HTTP/1.1,[http/1.1]}{127.0.0.1:33111}
   [junit4]   2> 1471147 INFO  (jetty-launcher-2124-thread-4) [    ] o.e.j.s.Server Started @1473425ms
   [junit4]   2> 1471147 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33111}
   [junit4]   2> 1471147 ERROR (jetty-launcher-2124-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471148 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471148 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471148 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471148 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.112Z
   [junit4]   2> 1471151 INFO  (zkConnectionManagerCallback-2131-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471151 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471153 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471154 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471154 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1471155 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1471155 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1471155 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1471155 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@299387{/solr,null,AVAILABLE}
   [junit4]   2> 1471155 INFO  (zkConnectionManagerCallback-2133-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5bb40c{HTTP/1.1,[http/1.1]}{127.0.0.1:33283}
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.e.j.s.Server Started @1473434ms
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33283}
   [junit4]   2> 1471156 ERROR (jetty-launcher-2124-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471156 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.120Z
   [junit4]   2> 1471157 INFO  (zkConnectionManagerCallback-2135-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471157 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@cac48a{/solr,null,AVAILABLE}
   [junit4]   2> 1471158 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471158 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@df5ae9{HTTP/1.1,[http/1.1]}{127.0.0.1:34115}
   [junit4]   2> 1471158 INFO  (jetty-launcher-2124-thread-5) [    ] o.e.j.s.Server Started @1473436ms
   [junit4]   2> 1471158 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34115}
   [junit4]   2> 1471159 ERROR (jetty-launcher-2124-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1471159 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1471159 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1471159 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1471159 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-21T02:59:20.123Z
   [junit4]   2> 1471160 INFO  (zkConnectionManagerCallback-2138-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471160 INFO  (jetty-launcher-2124-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471160 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471161 INFO  (zkConnectionManagerCallback-2140-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471161 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10073f02eb00003, likely client has closed socket
   [junit4]   2> 1471163 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1471164 INFO  (jetty-launcher-2124-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471166 INFO  (zkConnectionManagerCallback-2143-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471175 INFO  (jetty-launcher-2124-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471175 INFO  (jetty-launcher-2124-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471178 INFO  (zkConnectionManagerCallback-2148-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471182 INFO  (jetty-launcher-2124-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471182 INFO  (zkConnectionManagerCallback-2153-thread-1-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471183 INFO  (zkConnectionManagerCallback-2155-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471183 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10073f02eb00008, likely client has closed socket
   [junit4]   2> 1471183 INFO  (jetty-launcher-2124-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39885/solr
   [junit4]   2> 1471184 INFO  (zkConnectionManagerCallback-2158-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471185 INFO  (zkConnectionManagerCallback-2165-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471185 INFO  (zkConnectionManagerCallback-2161-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471186 INFO  (zkConnectionManagerCallback-2167-thread-1-processing-n:127.0.0.1:36437_solr) [n:127.0.0.1:36437_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471186 INFO  (zkConnectionManagerCallback-2169-thread-1-processing-n:127.0.0.1:33111_solr) [n:127.0.0.1:33111_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471189 INFO  (zkConnectionManagerCallback-2173-thread-1-processing-n:127.0.0.1:33283_solr) [n:127.0.0.1:33283_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471190 INFO  (zkConnectionManagerCallback-2172-thread-1-processing-n:127.0.0.1:39175_solr) [n:127.0.0.1:39175_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471192 INFO  (zkConnectionManagerCallback-2175-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471330 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471330 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471330 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471330 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471330 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39175_solr
   [junit4]   2> 1471331 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36437_solr
   [junit4]   2> 1471331 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33421_solr
   [junit4]   2> 1471331 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33283_solr
   [junit4]   2> 1471332 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.c.Overseer Overseer (id=72185069450559506-127.0.0.1:39175_solr-n_0000000000) starting
   [junit4]   2> 1471332 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1471338 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471339 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1471341 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33111_solr
   [junit4]   2> 1471349 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34115_solr
   [junit4]   2> 1471396 INFO  (zkCallback-2168-thread-1-processing-n:127.0.0.1:33111_solr) [n:127.0.0.1:33111_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1471396 INFO  (zkCallback-2152-thread-1-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1471396 INFO  (zkCallback-2166-thread-1-processing-n:127.0.0.1:36437_solr) [n:127.0.0.1:36437_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1471396 INFO  (zkCallback-2174-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1471396 INFO  (zkCallback-2170-thread-1-processing-n:127.0.0.1:39175_solr) [n:127.0.0.1:39175_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1471406 INFO  (zkCallback-2171-thread-1-processing-n:127.0.0.1:33283_solr) [n:127.0.0.1:33283_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1471407 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39175_solr
   [junit4]   2> 1471408 INFO  (zkCallback-2152-thread-2-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1471409 INFO  (zkCallback-2166-thread-1-processing-n:127.0.0.1:36437_solr) [n:127.0.0.1:36437_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471409 INFO  (zkCallback-2174-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471409 INFO  (zkCallback-2168-thread-1-processing-n:127.0.0.1:33111_solr) [n:127.0.0.1:33111_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471411 INFO  (zkCallback-2171-thread-1-processing-n:127.0.0.1:33283_solr) [n:127.0.0.1:33283_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471411 INFO  (zkCallback-2152-thread-2-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471420 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1471495 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33421.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471504 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36437.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471525 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33421.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471525 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33421.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471527 INFO  (jetty-launcher-2124-thread-2) [n:127.0.0.1:33421_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node2/.
   [junit4]   2> 1471527 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36437.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471528 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36437.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471529 INFO  (jetty-launcher-2124-thread-3) [n:127.0.0.1:36437_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node3/.
   [junit4]   2> 1471537 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33111.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471549 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33111.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471550 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33111.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471551 INFO  (jetty-launcher-2124-thread-4) [n:127.0.0.1:33111_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node4/.
   [junit4]   2> 1471585 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33283.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471599 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33283.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471599 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33283.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471601 INFO  (jetty-launcher-2124-thread-6) [n:127.0.0.1:33283_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node6/.
   [junit4]   2> 1471633 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471647 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471648 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471649 INFO  (jetty-launcher-2124-thread-5) [n:127.0.0.1:34115_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node5/.
   [junit4]   2> 1471663 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39175.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471674 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39175.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471675 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39175.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1471676 INFO  (jetty-launcher-2124-thread-1) [n:127.0.0.1:39175_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node1/.
   [junit4]   2> 1471932 INFO  (zkConnectionManagerCallback-2189-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471933 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10073f02eb00013, likely client has closed socket
   [junit4]   2> 1471934 INFO  (zkConnectionManagerCallback-2193-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1471935 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 1471936 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39885/solr ready
   [junit4]   2> 1472138 INFO  (qtp22501017-11124) [n:127.0.0.1:33111_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&collection.configName=solrCloudCollectionConfig&name=facetcollection&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1472140 INFO  (OverseerThreadFactory-3505-thread-1-processing-n:127.0.0.1:39175_solr) [n:127.0.0.1:39175_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection facetcollection
   [junit4]   2> 1472246 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"facetcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33283/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472247 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"facetcollection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:39175/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472250 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"facetcollection_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36437/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472251 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"facetcollection_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33421/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472253 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"facetcollection_shard3_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34115/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472254 INFO  (OverseerStateUpdate-72185069450559506-127.0.0.1:39175_solr-n_0000000000) [n:127.0.0.1:39175_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"facetcollection",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"facetcollection_shard3_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33111/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1472458 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node12&name=facetcollection_shard3_replica_n10&action=CREATE&numShards=3&shard=shard3&wt=javabin
   [junit4]   2> 1472458 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node11&name=facetcollection_shard3_replica_n8&action=CREATE&numShards=3&shard=shard3&wt=javabin
   [junit4]   2> 1472458 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node9&name=facetcollection_shard2_replica_n6&action=CREATE&numShards=3&shard=shard2&wt=javabin
   [junit4]   2> 1472459 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node5&name=facetcollection_shard1_replica_n2&action=CREATE&numShards=3&shard=shard1&wt=javabin
   [junit4]   2> 1472458 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node3&name=facetcollection_shard1_replica_n1&action=CREATE&numShards=3&shard=shard1&wt=javabin
   [junit4]   2> 1472459 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472459 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472459 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472459 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472459 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472471 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=facetcollection&version=2&replicaType=NRT&property.config=solrconfig-blockjoinfacetcomponent.xml&property.schema=schema-blockjoinfacetcomponent.xml&coreNodeName=core_node7&name=facetcollection_shard2_replica_n4&action=CREATE&numShards=3&shard=shard2&wt=javabin
   [junit4]   2> 1472471 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1472574 INFO  (zkCallback-2152-thread-2-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2174-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2152-thread-1-processing-n:127.0.0.1:33421_solr) [n:127.0.0.1:33421_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2170-thread-1-processing-n:127.0.0.1:39175_solr) [n:127.0.0.1:39175_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2168-thread-1-processing-n:127.0.0.1:33111_solr) [n:127.0.0.1:33111_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472575 INFO  (zkCallback-2170-thread-2-processing-n:127.0.0.1:39175_solr) [n:127.0.0.1:39175_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2166-thread-1-processing-n:127.0.0.1:36437_solr) [n:127.0.0.1:36437_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472575 INFO  (zkCallback-2168-thread-2-processing-n:127.0.0.1:33111_solr) [n:127.0.0.1:33111_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472574 INFO  (zkCallback-2171-thread-1-processing-n:127.0.0.1:33283_solr) [n:127.0.0.1:33283_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472575 INFO  (zkCallback-2166-thread-2-processing-n:127.0.0.1:36437_solr) [n:127.0.0.1:36437_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472575 INFO  (zkCallback-2171-thread-2-processing-n:127.0.0.1:33283_solr) [n:127.0.0.1:33283_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1472575 INFO  (zkCallback-2174-thread-2-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/facetcollection/state.json] for collection [facetcollection] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1473484 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473501 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473502 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473503 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473505 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.s.IndexSchema [facetcollection_shard3_replica_n8] Schema name=test
   [junit4]   2> 1473508 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473510 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473510 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard3_replica_n8' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473511 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.core.facetcollection.shard3.replica_n8' (registry 'solr.core.facetcollection.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473511 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473511 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.c.SolrCore [[facetcollection_shard3_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node5/facetcollection_shard3_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node5/./facetcollection_shard3_replica_n8/data/]
   [junit4]   2> 1473512 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1473514 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.s.IndexSchema [facetcollection_shard2_replica_n6] Schema name=test
   [junit4]   2> 1473517 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473517 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard2_replica_n6' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473518 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33421.solr.core.facetcollection.shard2.replica_n6' (registry 'solr.core.facetcollection.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473518 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473518 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.c.SolrCore [[facetcollection_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node2/facetcollection_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node2/./facetcollection_shard2_replica_n6/data/]
   [junit4]   2> 1473520 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.s.IndexSchema [facetcollection_shard2_replica_n4] Schema name=test
   [junit4]   2> 1473568 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.s.IndexSchema [facetcollection_shard1_replica_n2] Schema name=test
   [junit4]   2> 1473570 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.s.IndexSchema [facetcollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1473574 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473574 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard1_replica_n1' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473574 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33283.solr.core.facetcollection.shard1.replica_n1' (registry 'solr.core.facetcollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473574 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473575 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.c.SolrCore [[facetcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node6/facetcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node6/./facetcollection_shard1_replica_n1/data/]
   [junit4]   2> 1473576 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473576 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard2_replica_n4' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473577 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36437.solr.core.facetcollection.shard2.replica_n4' (registry 'solr.core.facetcollection.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473577 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473577 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.c.SolrCore [[facetcollection_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node3/facetcollection_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node3/./facetcollection_shard2_replica_n4/data/]
   [junit4]   2> 1473590 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.s.IndexSchema [facetcollection_shard3_replica_n10] Schema name=test
   [junit4]   2> 1473593 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473594 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard3_replica_n10' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473594 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33111.solr.core.facetcollection.shard3.replica_n10' (registry 'solr.core.facetcollection.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473594 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473594 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.c.SolrCore [[facetcollection_shard3_replica_n10] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node4/facetcollection_shard3_replica_n10], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node4/./facetcollection_shard3_replica_n10/data/]
   [junit4]   2> 1473599 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1473599 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'facetcollection_shard1_replica_n2' using configuration from collection facetcollection, trusted=true
   [junit4]   2> 1473599 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39175.solr.core.facetcollection.shard1.replica_n2' (registry 'solr.core.facetcollection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a72d53
   [junit4]   2> 1473600 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1473600 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.c.SolrCore [[facetcollection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node1/facetcollection_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.search.join.BlockJoinFacetDistribTest_FE37B6B8804C4D10-001/tempDir-001/node1/./facetcollection_shard1_replica_n2/data/]
   [junit4]   2> 1473847 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473848 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473848 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473848 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473848 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473848 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473851 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473851 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473851 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473851 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473851 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473851 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473851 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473851 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473851 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473853 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473853 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473853 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473853 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473854 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1473854 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1473855 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@14f7ace[facetcollection_shard2_replica_n6] main]
   [junit4]   2> 1473855 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1473855 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473855 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.s.SolrIndexSearcher Opening [Searcher@1de4ef9[facetcollection_shard3_replica_n10] main]
   [junit4]   2> 1473857 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 1473857 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 1473858 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@c39b05[facetcollection_shard1_replica_n1] main]
   [junit4]   2> 1473858 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 1473851 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1473858 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 1473858 INFO  (qtp1989294-11105) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592977745848041472
   [junit4]   2> 1473859 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 1473859 INFO  (qtp515070-11132) [n:127.0.0.1:33283_solr c:facetcollection s:shard1 r:core_node3 x:facetcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 1473855 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@b32fc6[facetcollection_shard1_replica_n2] main]
   [junit4]   2> 1473861 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 1473861 INFO  (qtp30210226-11123) [n:127.0.0.1:34115_solr c:facetcollection s:shard3 r:core_node11 x:facetcollection_shard3_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@1416f90[facetcollection_shard3_replica_n8] main]
   [junit4]   2> 1473861 INFO  (searcherExecutor-3522-thread-1-processing-n:127.0.0.1:33111_solr x:facetcollection_shard3_replica_n10 s:shard3 c:facetcollection r:core_node12) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.c.SolrCore [facetcollection_shard3_replica_n10] Registered new searcher Searcher@1de4ef9[facetcollection_shard3_replica_n10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1473861 INFO  (qtp22501017-11146) [n:127.0.0.1:33111_solr c:facetcollection s:shard3 r:core_node12 x:facetcollection_shard3_replica_n10] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592977745851187200
   [junit4]   2> 1473861 INFO  (searcherExecutor-3519-thread-1-processing-n:127.0.0.1:33421_solr x:facetcollection_shard2_replica_n6 s:shard2 c:facetcollection r:core_node9) [n:127.0.0.1:33421_solr c:facetcollection s:shard2 r:core_node9 x:facetcollection_shard2_replica_n6] o.a.s.c.SolrCore [facetcollection_shard2_replica_n6] Registered new searcher Searcher@14f7ace[facetcollection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1473861 INFO  (qtp1550259-11104) [n:127.0.0.1:39175_solr c:facetcollection s:shard1 r:core_node5 x:facetcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 1473861 INFO  (qtp3267762-11115) [n:127.0.0.1:36437_solr c:facetcollection s:shard2 r:core_node7 x:facetcollection_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@183c494[facetcollection_shard2_replica_n4] main]
   [junit4]   2> 1473861 INFO  (searcherExecutor-3520-thread-1-processing-n:127.0.0.1:33283_solr x:facetcollection_shard1_replica_n1 s:shard1 c:facetcollection r:core_node3) [n:127.0.0.1:3

[...truncated too long message...]

terprops.json
   [junit4]   2> 	6	/solr/collections/facetcollection/terms/shard2
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 	5	/solr/collections/facetcollection/terms/shard3
   [junit4]   2> 	5	/solr/collections/facetcollection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/collections/facetcollection/state.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72185069450559506-127.0.0.1:39175_solr-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/72185069450559502-127.0.0.1:36437_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1511162 INFO  (SUITE-BlockJoinFacetDistribTest-seed#[FE37B6B8804C4D10]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 21, 2018 3:00:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Feb 21, 2018 3:00:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.search.join.BlockJoinFacetDistribTest: 
   [junit4]   2>    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
   [junit4]   2>         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]   2>         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]   2>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2>         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Feb 21, 2018 3:00:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
   [junit4]   2> Feb 21, 2018 3:00:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
   [junit4]   2>         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]   2>         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]   2>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2>         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {type_s=PostingsFormat(name=MockRandom), COLOR_s=FSTOrd50, SIZE_s=FSTOrd50, _root_=PostingsFormat(name=MockRandom), BRAND_s=FSTOrd50, id=FSTOrd50}, docValues:{}, maxPointsInLeafNode=496, maxMBSortInHeap=5.048635068415731, sim=RandomSimilarity(queryNorm=true): {}, locale=ar-MA, timezone=America/Belem
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=2,free=213641784,total=400031744
   [junit4]   2> NOTE: All tests run in this JVM: [TestApiFramework, TestHdfsBackupRestoreCore, BlockDirectoryTest, TestInitParams, OverseerCollectionConfigSetProcessorTest, TestQuerySenderListener, TestDFRSimilarityFactory, BigEndianAscendingWordDeserializerTest, DirectSolrSpellCheckerTest, TestLMJelinekMercerSimilarityFactory, TestSolrDeletionPolicy2, HdfsRestartWhileUpdatingTest, ExplicitHLLTest, MultiTermTest, TestRealTimeGet, CloudMLTQParserTest, TestLFUCache, TestOverriddenPrefixQueryForCustomFieldType, TestDistribStateManager, PreAnalyzedFieldTest, DocValuesTest, TestSegmentSorting, VersionInfoTest, TestGeoJSONResponseWriter, TestShardHandlerFactory, NotRequiredUniqueKeyTest, TestInPlaceUpdatesDistrib, AddBlockUpdateTest, TestUtils, TestInitQParser, TestBinaryResponseWriter, MetricsConfigTest, TestSolrCloudWithHadoopAuthPlugin, TestAuthorizationFramework, TestEmbeddedSolrServerConstructors, TestXmlQParser, TestSolrCloudWithSecureImpersonation, CdcrVersionReplicationTest, DisMaxRequestHandlerTest, DistribCursorPagingTest, DistributedQueueTest, TestSolrXml, TestSkipOverseerOperations, SearchRateTriggerTest, TestRebalanceLeaders, TestCloudManagedSchema, SolrGraphiteReporterTest, ClusterStateTest, MetricTriggerTest, ReturnFieldsTest, TestDistribDocBasedVersion, ConnectionManagerTest, RecoveryZkTest, TestUseDocValuesAsStored2, DistributedSuggestComponentTest, TestHalfAndHalfDocValues, OverseerStatusTest, FileBasedSpellCheckerTest, RequestLoggingTest, BooleanFieldTest, HdfsBasicDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, GraphQueryTest, TriLevelCompositeIdRoutingTest, DocValuesMultiTest, TestQueryTypes, CachingDirectoryFactoryTest, URLClassifyProcessorTest, SpatialFilterTest, TestValueSourceCache, TestTolerantUpdateProcessorRandomCloud, ExecutePlanActionTest, SolrMetricReporterTest, MoreLikeThisHandlerTest, DistributedFacetPivotLongTailTest, DateMathParserTest, HLLUtilTest, NodeMutatorTest, TestTolerantSearch, HdfsTlogReplayBufferedWhileIndexingTest, CacheHeaderTest, DistanceUnitsTest, DeleteReplicaTest, TestDynamicLoading, RollingRestartTest, TestCoreDiscovery, TimeZoneUtilsTest, StressHdfsTest, TestClusterProperties, SolrSlf4jReporterTest, RecoveryAfterSoftCommitTest, ClassificationUpdateProcessorTest, TestFieldTypeCollectionResource, TestCollectionsAPIViaSolrCloudCluster, TestStandardQParsers, TestSha256AuthenticationProvider, TestMissingGroups, TestFieldCacheVsDocValues, RulesTest, DirectoryFactoryTest, LeaderElectionTest, TestCoreContainer, CdcrReplicationDistributedZkTest, TestExactSharedStatsCache, BlockJoinFacetDistribTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BlockJoinFacetDistribTest -Dtests.seed=FE37B6B8804C4D10 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-MA -Dtests.timezone=America/Belem -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | BlockJoinFacetDistribTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.join.BlockJoinFacetDistribTest: 
   [junit4]    >    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
   [junit4]    >         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FE37B6B8804C4D10]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=11161, name=qtp515070-11161, state=TIMED_WAITING, group=TGRP-BlockJoinFacetDistribTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)
   [junit4]    >         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FE37B6B8804C4D10]:0)
   [junit4] Completed [314/777 (1!)] on J2 in 63.26s, 1 test, 2 errors <<< FAILURES!

[...truncated 45736 lines...]

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build # 1397 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1397/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([5F161D6C652347B:8DA55E0C68AE5983]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([5F161D6C652347B:680DC52B7C1ACB7C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:310)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.metrics.reporters.SolrJmxReporterCloudTest.testJmxReporter

Error Message:
Too few categories: []

Stack Trace:
java.lang.AssertionError: Too few categories: []
	at __randomizedtesting.SeedInfo.seed([5F161D6C652347B:944A9C7B85EDAC58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.metrics.reporters.SolrJmxReporterCloudTest.lambda$testJmxReporter$2(SolrJmxReporterCloudTest.java:107)
	at java.base/java.util.HashMap.forEach(HashMap.java:1341)
	at java.base/java.util.Collections$UnmodifiableMap.forEach(Collections.java:1501)
	at org.apache.solr.metrics.reporters.SolrJmxReporterCloudTest.testJmxReporter(SolrJmxReporterCloudTest.java:83)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1777 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20180220_220322_9413104373202521184803.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20180220_220322_94114793805074346227588.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20180220_220322_9419192665528179287539.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 283 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20180220_220942_4011854942913774377444.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 18 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20180220_220942_4026877756779000878918.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20180220_220942_40111792878419100181543.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1062 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20180220_221055_0972650237345311919096.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20180220_221055_0976397834056078869877.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20180220_221055_09715113494447871397371.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 242 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20180220_221221_74613842747942850162408.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20180220_221221_7461569823478466646471.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20180220_221221_7467364383549846240415.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 251 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20180220_221233_04414012050364330107193.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20180220_221233_04413443522057406490786.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20180220_221233_04417062508486902445219.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20180220_221258_1766238305846555509642.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20180220_221258_17617455304906637781624.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20180220_221258_17614062720068528512725.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20180220_221301_77121796713824296530.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20180220_221301_7711330499099645777456.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20180220_221301_7715833883694440520971.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 176 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20180220_221304_4942186254463311512646.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20180220_221304_4948779921776006676656.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20180220_221304_4943700608134742038052.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20180220_221313_6572712488385126210634.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20180220_221313_65711858023825553345626.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 165 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20180220_221320_59017703406960794670418.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20180220_221320_5904997658636800905271.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20180220_221320_5903221774602139991952.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 177 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20180220_221323_2409722541312752457672.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 200 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20180220_221331_65113906801209905885166.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 19 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20180220_221331_651675622220874288.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20180220_221331_65115025965863500834057.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1403 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20180220_221542_7893381258732041898117.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20180220_221542_7887592999511771448247.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20180220_221542_78717866107312954705283.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 250 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20180220_221552_14914962901219734790770.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20180220_221552_14915247701317841370330.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20180220_221552_14910079950311128439123.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 256 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20180220_221605_0204798939129649896156.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20180220_221605_02011858030265948244253.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20180220_221605_0201500976129862517226.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 236 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20180220_221858_1279255570841561648167.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20180220_221858_12712545846533148228354.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20180220_221858_1278271247637602505158.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 170 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20180220_221900_94910674469439386695081.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20180220_221900_9493645336091287965213.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20180220_221900_94918087317472451985031.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20180220_221906_4511910154724159982674.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20180220_221906_45111303090027951655269.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20180220_221906_4504066841761849607825.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 182 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20180220_221937_16117916270645844881721.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20180220_221937_16111271290724632774531.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20180220_221937_16117758745561430070277.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 255 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20180220_221956_16011161293931722286396.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20180220_221956_16013611284854882157664.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20180220_221956_1596191804457418528924.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 163 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20180220_222013_6904637277445130951663.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20180220_222013_6908786009697316580413.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20180220_222013_69013889909035241836056.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20180220_222040_6964329186609812777770.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20180220_222040_6963950311720044246437.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 187 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20180220_222050_6649680785784964000189.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20180220_222050_6642435417370819128370.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20180220_222050_66416053802217125418407.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 338 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20180220_222106_3855506543992962177615.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20180220_222106_38515247249499386916351.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20180220_222106_38513503934994529540342.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 238 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20180220_222115_5313152114065620643524.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20180220_222115_5328646414982654883380.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20180220_222115_5318472700008523698619.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 212 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20180220_222124_317988304815224285855.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20180220_222124_315622005591688043237.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20180220_222124_3168317159359831225074.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 203 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20180220_222137_4771141070309887182636.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20180220_222137_46116525813664064171194.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 21 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20180220_222137_48417044622990641540419.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 314 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20180220_222229_57914386243955792705694.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20180220_222229_5795500187936584424470.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20180220_222229_5792872263869257386861.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20180220_222248_75118030832972824377720.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 184 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20180220_222250_765873507950909483336.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20180220_222250_7655212644610042696204.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20180220_222250_7651732328303820037249.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 245 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20180220_222405_630395381962348747679.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 18 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20180220_222405_63114199232498911396395.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20180220_222405_6312520509837024031803.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3409 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/init-core-data-001
   [junit4]   2> 2413046 WARN  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 2413047 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2413047 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2413047 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2413047 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001
   [junit4]   2> 2413048 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2413048 INFO  (Thread-9288) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2413048 INFO  (Thread-9288) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2413049 ERROR (Thread-9288) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2413148 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:43637
   [junit4]   2> 2413149 INFO  (zkConnectionManagerCallback-4022-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413158 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ٢٠١٧-١١-٢١T١٦:٢٧:٣٧-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2413169 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413169 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413169 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@412f1810{/solr,null,AVAILABLE}
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24f93a8e{/solr,null,AVAILABLE}
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2413170 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@57498e7{SSL,[ssl, http/1.1]}{127.0.0.1:٤٤٨٢٩}
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٢ms
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44829}
   [junit4]   2> 2413171 ERROR (jetty-launcher-4019-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413171 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.849783Z
   [junit4]   2> 2413172 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6efff227{/solr,null,AVAILABLE}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@c4eac30{/solr,null,AVAILABLE}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1db5a044{/solr,null,AVAILABLE}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1bc29199{SSL,[ssl, http/1.1]}{127.0.0.1:٤٥٧٤٩}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@60e01f38{SSL,[ssl, http/1.1]}{127.0.0.1:٣٩٢٠٩}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-2) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٤ms
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-1) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٤ms
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45749}
   [junit4]   2> 2413173 INFO  (zkConnectionManagerCallback-4024-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@ae38043{SSL,[ssl, http/1.1]}{127.0.0.1:٣٥٩٤٥}
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2413173 ERROR (jetty-launcher-4019-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-6) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٤ms
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35945}
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39209}
   [junit4]   2> 2413174 ERROR (jetty-launcher-4019-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413173 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1ee547cd{SSL,[ssl, http/1.1]}{127.0.0.1:٣٧٧١٣}
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-3) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٥ms
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37713}
   [junit4]   2> 2413174 ERROR (jetty-launcher-4019-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413174 ERROR (jetty-launcher-4019-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.853182Z
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.853213Z
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.852421Z
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2413174 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413175 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.853482Z
   [junit4]   2> 2413176 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@113fdccc{/solr,null,AVAILABLE}
   [junit4]   2> 2413176 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4053d46f{SSL,[ssl, http/1.1]}{127.0.0.1:٣٥٢٢٣}
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.e.j.s.Server Started @٢٤١٤٩٣٧ms
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35223}
   [junit4]   2> 2413177 INFO  (zkConnectionManagerCallback-4032-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413177 ERROR (jetty-launcher-4019-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2413177 INFO  (zkConnectionManagerCallback-4026-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2413177 INFO  (zkConnectionManagerCallback-4030-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T23:05:17.855640Z
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413177 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413180 INFO  (zkConnectionManagerCallback-4028-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413180 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007319ea140002, likely client has closed socket
   [junit4]   2> 2413180 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007319ea140003, likely client has closed socket
   [junit4]   2> 2413180 INFO  (jetty-launcher-4019-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413180 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413181 INFO  (jetty-launcher-4019-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413189 INFO  (zkConnectionManagerCallback-4038-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413189 INFO  (zkConnectionManagerCallback-4035-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413189 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2413192 INFO  (jetty-launcher-4019-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413197 INFO  (zkConnectionManagerCallback-4046-thread-1-processing-n:127.0.0.1:44829_solr) [n:127.0.0.1:44829_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413197 INFO  (jetty-launcher-4019-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413198 INFO  (jetty-launcher-4019-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413200 INFO  (zkConnectionManagerCallback-4044-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413202 INFO  (zkConnectionManagerCallback-4049-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413203 INFO  (jetty-launcher-4019-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43637/solr
   [junit4]   2> 2413203 INFO  (zkConnectionManagerCallback-4053-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413203 INFO  (zkConnectionManagerCallback-4056-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413203 INFO  (zkConnectionManagerCallback-4060-thread-1-processing-n:127.0.0.1:45749_solr) [n:127.0.0.1:45749_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413203 INFO  (zkConnectionManagerCallback-4063-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413204 INFO  (zkConnectionManagerCallback-4065-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413204 INFO  (zkConnectionManagerCallback-4069-thread-1-processing-n:127.0.0.1:39209_solr) [n:127.0.0.1:39209_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413204 INFO  (zkConnectionManagerCallback-4067-thread-1-processing-n:127.0.0.1:37713_solr) [n:127.0.0.1:37713_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413204 INFO  (zkConnectionManagerCallback-4071-thread-1-processing-n:127.0.0.1:35223_solr) [n:127.0.0.1:35223_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2413208 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413208 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413208 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35945_solr
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39209_solr
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45749_solr
   [junit4]   2> 2413209 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.c.Overseer Overseer (id=72184149176483855-127.0.0.1:35945_solr-n_0000000000) starting
   [junit4]   2> 2413210 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35223_solr
   [junit4]   2> 2413211 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37713_solr
   [junit4]   2> 2413228 INFO  (zkCallback-4070-thread-1-processing-n:127.0.0.1:35223_solr) [n:127.0.0.1:35223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2413228 INFO  (zkCallback-4059-thread-1-processing-n:127.0.0.1:45749_solr) [n:127.0.0.1:45749_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2413228 INFO  (zkCallback-4068-thread-1-processing-n:127.0.0.1:39209_solr) [n:127.0.0.1:39209_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2413228 INFO  (zkCallback-4064-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2413228 INFO  (zkCallback-4066-thread-1-processing-n:127.0.0.1:37713_solr) [n:127.0.0.1:37713_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2413235 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35945_solr
   [junit4]   2> 2413236 INFO  (zkCallback-4059-thread-1-processing-n:127.0.0.1:45749_solr) [n:127.0.0.1:45749_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2413236 INFO  (zkCallback-4066-thread-1-processing-n:127.0.0.1:37713_solr) [n:127.0.0.1:37713_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2413236 INFO  (zkCallback-4064-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2413236 INFO  (zkCallback-4068-thread-1-processing-n:127.0.0.1:39209_solr) [n:127.0.0.1:39209_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2413236 INFO  (zkCallback-4070-thread-2-processing-n:127.0.0.1:35223_solr) [n:127.0.0.1:35223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2413237 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 2413237 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2413238 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44829_solr
   [junit4]   2> 2413238 INFO  (zkCallback-4066-thread-1-processing-n:127.0.0.1:37713_solr) [n:127.0.0.1:37713_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2413238 INFO  (zkCallback-4059-thread-1-processing-n:127.0.0.1:45749_solr) [n:127.0.0.1:45749_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2413238 INFO  (zkCallback-4070-thread-2-processing-n:127.0.0.1:35223_solr) [n:127.0.0.1:35223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2413238 INFO  (zkCallback-4064-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2413240 INFO  (zkCallback-4068-thread-1-processing-n:127.0.0.1:39209_solr) [n:127.0.0.1:39209_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2413240 INFO  (zkCallback-4045-thread-1-processing-n:127.0.0.1:44829_solr) [n:127.0.0.1:44829_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2423246 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45749.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2423251 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45749.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2423251 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45749.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2423252 INFO  (jetty-launcher-4019-thread-2) [n:127.0.0.1:45749_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node2/.
   [junit4]   2> 2428247 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39209.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428248 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35945.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428252 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39209.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428252 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39209.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428253 INFO  (jetty-launcher-4019-thread-1) [n:127.0.0.1:39209_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node1/.
   [junit4]   2> 2428254 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35945.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428254 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35945.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2428255 INFO  (jetty-launcher-4019-thread-6) [n:127.0.0.1:35945_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node6/.
   [junit4]   2> 2433238 WARN  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.h.a.SystemInfoHandler Resolving canonical hostname for local host took 20.005 seconds, possible DNS misconfiguration. Set the 'solr.dns.prevent.reverse.lookup' sysprop to true on startup to prevent future lookups if DNS can not be fixed.
   [junit4]   2> 2433241 WARN  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.h.a.SystemInfoHandler Resolving canonical hostname for local host took 20.009 seconds, possible DNS misconfiguration. Set the 'solr.dns.prevent.reverse.lookup' sysprop to true on startup to prevent future lookups if DNS can not be fixed.
   [junit4]   2> 2433241 WARN  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.h.a.SystemInfoHandler Resolving canonical hostname for local host took 19.983 seconds, possible DNS misconfiguration. Set the 'solr.dns.prevent.reverse.lookup' sysprop to true on startup to prevent future lookups if DNS can not be fixed.
   [junit4]   2> 2433253 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35223.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433255 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37713.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433255 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44829.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433259 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35223.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433259 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35223.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433260 INFO  (jetty-launcher-4019-thread-4) [n:127.0.0.1:35223_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node4/.
   [junit4]   2> 2433261 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44829.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433261 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37713.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433261 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44829.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433261 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37713.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@325fe2f6
   [junit4]   2> 2433262 INFO  (jetty-launcher-4019-thread-5) [n:127.0.0.1:44829_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node5/.
   [junit4]   2> 2433262 INFO  (jetty-launcher-4019-thread-3) [n:127.0.0.1:37713_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplaceNodeNoTargetTest_5F161D6C652347B-001/tempDir-001/node3/.
   [junit4]   2> 2433347 INFO  (zkConnectionManagerCallback-4084-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2433350 INFO  (zkConnectionManagerCallback-4088-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2433351 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 2433351 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[5F161D6C652347B]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43637/solr ready
   [junit4]   2> 2433367 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[5F161D6C652347B]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 2433368 INFO  (zkConnectionManagerCallback-4090-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2433369 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[5F161D6C652347B]) [    ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
   [junit4]   2> 2433385 INFO  (qtp1586984809-24201) [n:127.0.0.1:35223_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433393 INFO  (qtp631625345-24185) [n:127.0.0.1:35945_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433407 INFO  (qtp1616239041-24194) [n:127.0.0.1:37713_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433418 INFO  (qtp2106042835-24186) [n:127.0.0.1:39209_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433428 INFO  (qtp1227298676-24174) [n:127.0.0.1:44829_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433437 INFO  (qtp1694407937-24195) [n:127.0.0.1:45749_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433437 INFO  (qtp2106042835-24193) [n:127.0.0.1:39209_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=60
   [junit4]   2> 2433440 INFO  (qtp1227298676-24173) [n:127.0.0.1:44829_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2433441 INFO  (OverseerThreadFactory-8435-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
   [junit4]   2> 2433445 INFO  (qtp1586984809-24198) [n:127.0.0.1:35223_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433448 INFO  (qtp631625345-24184) [n:127.0.0.1:35945_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433450 INFO  (qtp1616239041-24192) [n:127.0.0.1:37713_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433453 INFO  (qtp2106042835-24186) [n:127.0.0.1:39209_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433455 INFO  (qtp1227298676-24323) [n:127.0.0.1:44829_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433458 INFO  (qtp1694407937-24191) [n:127.0.0.1:45749_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2433462 INFO  (OverseerThreadFactory-8435-thread-1-processing-n:127.0.0.1:35945_solr) [n:127.0.0.1:35945_solr    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1931098578 sessionWrapper.createTime 1931098574002945, this.sessionWrapper.createTime 1931098574002945 
   [junit4]   2> 2433566 INFO  (OverseerStateUpdate-72184149176483855-127.0.0.1:35945_solr-n_0000000000) [n:127.0.0.1:35945_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:45749/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2433567 INFO  (OverseerStateUpdate-7218414

[...truncated too long message...]

--
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20180220_233418_61117356887480149602888.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 565 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20180220_233546_83710403700576003469655.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20180220_233546_8372322376178179178812.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20180220_233546_83714806521700190683066.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1279 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20180220_233612_9221793573893062366353.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20180220_233612_9228227433602431425959.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 656 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20180220_233629_6694621136984276723402.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20180220_233629_6694901055866216093202.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20180220_233629_66916734059455184736367.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 566 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20180220_233705_40017649571669486277656.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20180220_233705_40014524532933977506440.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20180220_233705_40012476557817353448775.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 569 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J2-20180220_233722_7679165773209543477236.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20180220_233722_7671161425726179316757.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20180220_233722_76715771947015349132220.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 673 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20180220_233746_28410773891703141755540.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20180220_233746_28410938676784732913763.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20180220_233746_28413509197701479708798.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 611 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20180220_233819_20615376158061654033417.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20180220_233819_20610738750397955755919.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 557 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20180220_233839_6569344636092865312674.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 32536 lines...]

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build # 1396 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1396/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseParallelGC

8 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest:     1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest: 
   1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyRangeFacetCloudTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyRangeFacetCloudTest:     1) Thread[id=51, name=qtp498975676-51, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)    2) Thread[id=68, name=qtp498975676-68, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyRangeFacetCloudTest: 
   1) Thread[id=51, name=qtp498975676-51, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=68, name=qtp498975676-68, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyRangeFacetCloudTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=51, name=qtp498975676-51, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)    2) Thread[id=68, name=qtp498975676-68, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=51, name=qtp498975676-51, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=68, name=qtp498975676-68, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
        at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
        at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@10/java.lang.Thread.run(Thread.java:844)
	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)


FAILED:  org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate

Error Message:
Error from server at http://127.0.0.1:39471/solr: Can't create collection alias for collections='testTimezoneAbsoluteDate_2018-01-15', 'testTimezoneAbsoluteDate_2018-01-15' is not an existing collection or alias

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39471/solr: Can't create collection alias for collections='testTimezoneAbsoluteDate_2018-01-15', 'testTimezoneAbsoluteDate_2018-01-15' is not an existing collection or alias
	at __randomizedtesting.SeedInfo.seed([9E10684D89C0BAA5:3BF015201D87E3DB]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate(CreateRoutedAliasTest.java:237)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.CreateRoutedAliasTest.testV1

Error Message:
Unexpected status: HTTP/1.1 400 Bad Request

Stack Trace:
java.lang.AssertionError: Unexpected status: HTTP/1.1 400 Bad Request
	at __randomizedtesting.SeedInfo.seed([9E10684D89C0BAA5:31DEAF3DC82D1635]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.CreateRoutedAliasTest.assertSuccess(CreateRoutedAliasTest.java:343)
	at org.apache.solr.cloud.CreateRoutedAliasTest.testV1(CreateRoutedAliasTest.java:198)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.CreateRoutedAliasTest.testV2

Error Message:
Unexpected status: HTTP/1.1 400 Bad Request

Stack Trace:
java.lang.AssertionError: Unexpected status: HTTP/1.1 400 Bad Request
	at __randomizedtesting.SeedInfo.seed([9E10684D89C0BAA5:5F55342D192B1F74]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.CreateRoutedAliasTest.assertSuccess(CreateRoutedAliasTest.java:343)
	at org.apache.solr.cloud.CreateRoutedAliasTest.testV2(CreateRoutedAliasTest.java:140)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.store.blockcache.BlockDirectoryTest.testEOF

Error Message:
Direct buffer memory

Stack Trace:
java.lang.OutOfMemoryError: Direct buffer memory
	at java.base/java.nio.Bits.reserveMemory(Bits.java:187)
	at java.base/java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
	at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:310)
	at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:71)
	at org.apache.solr.store.blockcache.BlockDirectoryTest.setUp(BlockDirectoryTest.java:119)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12219 lines...]
   [junit4] Suite: org.apache.solr.cloud.CreateRoutedAliasTest
   [junit4]   2> 63063 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_9E10684D89C0BAA5-001/init-core-data-001
   [junit4]   2> 63064 WARN  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 63064 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 63064 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
   [junit4]   2> 63065 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_9E10684D89C0BAA5-001/tempDir-001
   [junit4]   2> 63065 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 63065 INFO  (Thread-119) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 63065 INFO  (Thread-119) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 63067 ERROR (Thread-119) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 63165 INFO  (SUITE-CreateRoutedAliasTest-seed#[9E10684D89C0BAA5]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:33759
   [junit4]   2> 63169 INFO  (zkConnectionManagerCallback-90-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63175 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+12:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 63175 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+12:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3966e538{/solr,null,AVAILABLE}
   [junit4]   2> 63182 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@124bede0{/solr,null,AVAILABLE}
   [junit4]   2> 63183 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@12879df6{HTTP/1.1,[http/1.1]}{127.0.0.1:39471}
   [junit4]   2> 63183 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2dc0bee6{HTTP/1.1,[http/1.1]}{127.0.0.1:42033}
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.e.j.s.Server Started @65902ms
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42033}
   [junit4]   2> 63184 ERROR (jetty-launcher-87-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 63184 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T18:21:27.364358Z
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.e.j.s.Server Started @65902ms
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39471}
   [junit4]   2> 63185 ERROR (jetty-launcher-87-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 63185 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T18:21:27.365597Z
   [junit4]   2> 63185 INFO  (zkConnectionManagerCallback-92-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63186 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 63188 INFO  (zkConnectionManagerCallback-94-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63188 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 63195 INFO  (jetty-launcher-87-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33759/solr
   [junit4]   2> 63196 INFO  (jetty-launcher-87-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33759/solr
   [junit4]   2> 63204 INFO  (zkConnectionManagerCallback-99-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63204 INFO  (zkConnectionManagerCallback-102-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63209 INFO  (zkConnectionManagerCallback-106-thread-1-processing-n:127.0.0.1:42033_solr) [n:127.0.0.1:42033_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63209 INFO  (zkConnectionManagerCallback-105-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63292 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 63293 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39471_solr
   [junit4]   2> 63294 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.Overseer Overseer (id=72183033066881030-127.0.0.1:39471_solr-n_0000000000) starting
   [junit4]   2> 63309 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 63310 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42033_solr
   [junit4]   2> 63319 INFO  (OverseerStateUpdate-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 63327 INFO  (zkCallback-103-thread-1-processing-n:127.0.0.1:42033_solr) [n:127.0.0.1:42033_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 63329 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39471_solr
   [junit4]   2> 63330 INFO  (zkCallback-103-thread-1-processing-n:127.0.0.1:42033_solr) [n:127.0.0.1:42033_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 63336 INFO  (zkCallback-104-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 63522 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42033.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63535 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42033.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63535 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42033.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63536 INFO  (jetty-launcher-87-thread-2) [n:127.0.0.1:42033_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_9E10684D89C0BAA5-001/tempDir-001/node2/.
   [junit4]   2> 63708 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63715 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63716 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f2220b
   [junit4]   2> 63717 INFO  (jetty-launcher-87-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CreateRoutedAliasTest_9E10684D89C0BAA5-001/tempDir-001/node1/.
   [junit4]   2> 63737 INFO  (zkConnectionManagerCallback-112-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63746 INFO  (TEST-CreateRoutedAliasTest.testAliasNameMustBeValid-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAliasNameMustBeValid
   [junit4]   2> 63768 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 63770 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 63785 INFO  (zkConnectionManagerCallback-117-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 63787 INFO  (TEST-CreateRoutedAliasTest.testAliasNameMustBeValid-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 63787 INFO  (TEST-CreateRoutedAliasTest.testAliasNameMustBeValid-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33759/solr ready
   [junit4]   2> 63788 INFO  (TEST-CreateRoutedAliasTest.testAliasNameMustBeValid-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 63795 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=735741!45&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json and sendToOCPQueue=true
   [junit4]   2> 63796 ERROR (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Invalid alias: [735741!45]. alias names must consist entirely of periods, underscores, hyphens, and alphanumerics as well not start with a hyphen
   [junit4]   2> 	at org.apache.solr.client.solrj.util.SolrIdentifierValidator.validateName(SolrIdentifierValidator.java:39)
   [junit4]   2> 	at org.apache.solr.client.solrj.util.SolrIdentifierValidator.validateAliasName(SolrIdentifierValidator.java:52)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$6(CollectionsHandler.java:530)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1102)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:232)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 63796 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=735741!45&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json} status=400 QTime=0
   [junit4]   2> 63797 INFO  (TEST-CreateRoutedAliasTest.testAliasNameMustBeValid-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAliasNameMustBeValid
   [junit4]   2> 63803 INFO  (TEST-CreateRoutedAliasTest.testNegativeFutureFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNegativeFutureFails
   [junit4]   2> 63804 INFO  (TEST-CreateRoutedAliasTest.testNegativeFutureFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 63807 INFO  (qtp111923545-522) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testNegativeFutureFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json&router.maxFutureMs=-60000 and sendToOCPQueue=true
   [junit4]   2> 63823 ERROR (OverseerThreadFactory-371-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testNegativeFutureFails operation: createroutedalias failed:org.apache.solr.common.SolrException: router.maxFutureMs must be >= 0
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.TimeRoutedAlias.<init>(TimeRoutedAlias.java:170)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.callCreateRoutedAlias(CreateAliasCmd.java:116)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.call(CreateAliasCmd.java:65)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 63836 INFO  (qtp111923545-522) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testNegativeFutureFails&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json&router.maxFutureMs=-60000} status=400 QTime=29
   [junit4]   2> 63837 INFO  (TEST-CreateRoutedAliasTest.testNegativeFutureFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNegativeFutureFails
   [junit4]   2> 63844 INFO  (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTimezoneAbsoluteDate
   [junit4]   2> 63856 INFO  (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 63872 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 63873 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 63886 INFO  (qtp111923545-522) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 63888 INFO  (qtp111923545-522) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 63889 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 63895 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 63908 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&TZ=GMT-10:00&router.name=time&create-collection.numShards=1&create-collection.nrtReplicas=1&version=2&router.interval=%2B30MINUTE&router.field=evt_dt&name=testTimezoneAbsoluteDate&action=CREATEROUTEDALIAS&wt=javabin&create-collection.replicationFactor=1 and sendToOCPQueue=true
   [junit4]   2> 63916 INFO  (OverseerCollectionConfigSetProcessor-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 63919 INFO  (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testTimezoneAbsoluteDate_2018-01-15
   [junit4]   2> 64027 INFO  (OverseerStateUpdate-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testTimezoneAbsoluteDate_2018-01-15",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:39471/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 64238 INFO  (qtp111923545-515) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testTimezoneAbsoluteDate_2018-01-15&version=2&replicaType=NRT&property.routedAliasName=testTimezoneAbsoluteDate&coreNodeName=core_node2&name=testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 64238 INFO  (qtp111923545-515) [n:127.0.0.1:39471_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 64357 INFO  (zkCallback-104-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 64357 INFO  (zkCallback-104-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 65265 ERROR (qtp111923545-515) [n:127.0.0.1:39471_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1': Unable to create core [testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] Caused by: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:989)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:455)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unable to create core [testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1055)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:950)
   [junit4]   2> 	... 39 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Could not load conf for core testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1: Error loading solr config from solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:97)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.getConfigSet(CoreContainer.java:1083)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1035)
   [junit4]   2> 	... 40 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Error loading solr config from solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:189)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:109)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:91)
   [junit4]   2> 	... 42 more
   [junit4]   2> Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:130)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader.java:362)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:120)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:90)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:204)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:181)
   [junit4]   2> 	... 44 more
   [junit4]   2> 
   [junit4]   2> 65266 INFO  (qtp111923545-515) [n:127.0.0.1:39471_solr c:testTimezoneAbsoluteDate_2018-01-15 s:shard1 r:core_node2 x:testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testTimezoneAbsoluteDate_2018-01-15&version=2&replicaType=NRT&property.routedAliasName=testTimezoneAbsoluteDate&coreNodeName=core_node2&name=testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=400 QTime=1028
   [junit4]   2> 65267 ERROR (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:39471/solr
   [junit4]   2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39471/solr: Error CREATEing SolrCore 'testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1': Unable to create core [testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1] Caused by: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 65271 ERROR (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Cleaning up collection [testTimezoneAbsoluteDate_2018-01-15].
   [junit4]   2> 65272 INFO  (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true, asyncId=null
   [junit4]   2> 65276 INFO  (qtp111923545-519) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=testTimezoneAbsoluteDate_2018-01-15_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 65381 INFO  (zkCallback-104-thread-3-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 65381 INFO  (zkCallback-104-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/testTimezoneAbsoluteDate_2018-01-15/state.json] for collection [testTimezoneAbsoluteDate_2018-01-15] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 65981 INFO  (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.CreateCollectionCmd Cleaned up artifacts for failed create collection for [testTimezoneAbsoluteDate_2018-01-15]
   [junit4]   2> 65981 INFO  (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 95984 ERROR (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to become ACTIVE with timeout=30
   [junit4]   2> 95984 ERROR (OverseerThreadFactory-371-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testTimezoneAbsoluteDate operation: createroutedalias failed:org.apache.solr.common.SolrException: Can't create collection alias for collections='testTimezoneAbsoluteDate_2018-01-15', 'testTimezoneAbsoluteDate_2018-01-15' is not an existing collection or alias
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.validateAllCollectionsExistAndNoDups(CreateAliasCmd.java:159)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.callCreateRoutedAlias(CreateAliasCmd.java:125)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.call(CreateAliasCmd.java:65)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 95987 INFO  (qtp111923545-511) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&TZ=GMT-10:00&router.name=time&create-collection.numShards=1&create-collection.nrtReplicas=1&version=2&router.interval=%2B30MINUTE&router.field=evt_dt&name=testTimezoneAbsoluteDate&action=CREATEROUTEDALIAS&wt=javabin&create-collection.replicationFactor=1} status=400 QTime=32079
   [junit4]   2> 95988 INFO  (TEST-CreateRoutedAliasTest.testTimezoneAbsoluteDate-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTimezoneAbsoluteDate
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CreateRoutedAliasTest -Dtests.method=testTimezoneAbsoluteDate -Dtests.seed=9E10684D89C0BAA5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GF -Dtests.timezone=America/Moncton -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   32.2s J1 | CreateRoutedAliasTest.testTimezoneAbsoluteDate <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39471/solr: Can't create collection alias for collections='testTimezoneAbsoluteDate_2018-01-15', 'testTimezoneAbsoluteDate_2018-01-15' is not an existing collection or alias
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9E10684D89C0BAA5:3BF015201D87E3DB]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
   [junit4]    > 	at org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate(CreateRoutedAliasTest.java:237)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 95995 INFO  (TEST-CreateRoutedAliasTest.testRandomRouterNameFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRandomRouterNameFails
   [junit4]   2> 95998 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 95998 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 96000 INFO  (TEST-CreateRoutedAliasTest.testRandomRouterNameFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 96002 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testRandomRouterNameFails&router.name=tiafasme&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json and sendToOCPQueue=true
   [junit4]   2> 96003 INFO  (OverseerCollectionConfigSetProcessor-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 96003 ERROR (OverseerThreadFactory-371-thread-3-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: testRandomRouterNameFails operation: createroutedalias failed:org.apache.solr.common.SolrException: Only 'time' routed aliases is supported right now.
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.TimeRoutedAlias.<init>(TimeRoutedAlias.java:135)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.callCreateRoutedAlias(CreateAliasCmd.java:116)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.CreateAliasCmd.call(CreateAliasCmd.java:65)
   [junit4]   2> 	at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:469)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 96005 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={router.interval=%2B30MINUTE&router.start=2018-01-15T00:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testRandomRouterNameFails&router.name=tiafasme&create-collection.numShards=1&action=CREATEROUTEDALIAS&wt=json} status=400 QTime=3
   [junit4]   2> 96006 INFO  (TEST-CreateRoutedAliasTest.testRandomRouterNameFails-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRandomRouterNameFails
   [junit4]   2> 96012 INFO  (TEST-CreateRoutedAliasTest.testV1-seed#[9E10684D89C0BAA5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testV1
   [junit4]   2> 96013 INFO  (TEST-CreateRoutedAliasTest.testV1-seed#[9E10684D89C0BAA5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 96014 INFO  (qtp240520436-510) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createroutedalias with params router.interval=%2B30MINUTE&router.start=2018-02-20T18:00:00Z&create-collection.collection.configName=_default&router.field=evt_dt&name=testV1&router.name=time&create-collection.numShards=1&action=CREATEROUTEDALIAS&create-collection.router.field=foo_s&wt=xml&create-collection.replicationFactor=2 and sendToOCPQueue=true
   [junit4]   2> 96016 INFO  (OverseerCollectionConfigSetProcessor-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 96017 INFO  (OverseerThreadFactory-371-thread-4-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testV1_2018-02-20_18
   [junit4]   2> 96122 INFO  (OverseerStateUpdate-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testV1_2018-02-20_18",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testV1_2018-02-20_18_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42033/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96123 INFO  (OverseerStateUpdate-72183033066881030-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testV1_2018-02-20_18",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testV1_2018-02-20_18_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:39471/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96326 INFO  (qtp240520436-512) [n:127.0.0.1:42033_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-20_18&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node3&name=testV1_2018-02-20_18_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 96327 INFO  (qtp240520436-512) [n:127.0.0.1:42033_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96327 INFO  (qtp111923545-515) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=testV1_2018-02-20_18&version=2&replicaType=NRT&property.routedAliasName=testV1&coreNodeName=core_node4&name=testV1_2018-02-20_18_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 96432 INFO  (zkCallback-104-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-20_18/state.json] for collection [testV1_2018-02-20_18] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96432 INFO  (zkCallback-103-thread-1-processing-n:127.0.0.1:42033_solr) [n:127.0.0.1:42033_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-20_18/state.json] for collection [testV1_2018-02-20_18] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96432 INFO  (zkCallback-104-thread-3-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-20_18/state.json] for collection [testV1_2018-02-20_18] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96433 INFO  (zkCallback-103-thread-2-processing-n:127.0.0.1:42033_solr) [n:127.0.0.1:42033_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testV1_2018-02-20_18/state.json] for collection [testV1_2018-02-20_18] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 97335 ERROR (qtp240520436-512) [n:127.0.0.1:42033_solr c:testV1_2018-02-20_18 s:shard1 r:core_node3 x:testV1_2018-02-20_18_shard1_replica_n1] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'testV1_2018-02-20_18_shard1_replica_n1': Unable to create core [testV1_2018-02-20_18_shard1_replica_n1] Caused by: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:989)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:455)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unable to create core [testV1_2018-02-20_18_shard1_replica_n1]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1055)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:950)
   [junit4]   2> 	... 39 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Could not load conf for core testV1_2018-02-20_18_shard1_replica_n1: Error loading solr config from solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:97)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.getConfigSet(CoreContainer.java:1083)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1035)
   [junit4]   2> 	... 40 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Error loading solr config from solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:189)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:109)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:91)
   [junit4]   2> 	... 42 more
   [junit4]   2> Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:130)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader.java:362)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:120)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:90)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:204)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:181)
   [junit4]   2> 	... 44 more
   [junit4]   2> 
   [junit4]   2> 97335 ERROR (qtp111923545-515) [n:127.0.0.1:39471_solr c:testV1_2018-02-20_18 s:shard1 r:core_node4 x:testV1_2018-02-20_18_shard1_replica_n2] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'testV1_2018-02-20_18_shard1_replica_n2': Unable to create core [testV1_2018-02-20_18_shard1_replica_n2] Caused by: Can't find resource 'solrconfig.xml' in classpath or '/configs/_default', cwd=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:989)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:195)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handle

[...truncated too long message...]

tty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=51, name=qtp498975676-51, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
   [junit4]    >         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    2) Thread[id=68, name=qtp498975676-68, state=TIMED_WAITING, group=TGRP-LegacyRangeFacetCloudTest]
   [junit4]    >         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)
   [junit4] Completed [43/78 (1!)] on J0 in 68.41s, 3 tests, 2 errors <<< FAILURES!

[...truncated 31 lines...]
   [junit4] Suite: org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/J1/temp/solr.analytics.legacy.facet.LegacyQueryFacetCloudTest_464E32CEFC406BD4-001/init-core-data-001
   [junit4]   2> Feb 20, 2018 7:29:09 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Feb 20, 2018 7:29:29 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest: 
   [junit4]   2>    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
   [junit4]   2>         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]   2>         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2>         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Feb 20, 2018 7:29:29 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
   [junit4]   2> Feb 20, 2018 7:29:32 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
   [junit4]   2>         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]   2>         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2>         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2>         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {string_sd=PostingsFormat(name=LuceneVarGapFixedInterval), id=Lucene50(blocksize=128)}, docValues:{long_ld=DocValuesFormat(name=Memory), date_dtd=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Lucene70), string_sd=DocValuesFormat(name=Direct), int_id=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), double_dd=DocValuesFormat(name=Lucene70), float_fd=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1738, maxMBSortInHeap=5.755925606554089, sim=RandomSimilarity(queryNorm=false): {}, locale=ti, timezone=Etc/UCT
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=2,free=403455496,total=520093696
   [junit4]   2> NOTE: All tests run in this JVM: [DateParseFunctionTest, CastingLongValueStreamTest, ExistsFunctionTest, LegacyRangeFacetTest, LegacyAbstractAnalyticsTest, CeilingFunctionTest, LegacyQueryFacetCloudTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LegacyQueryFacetCloudTest -Dtests.seed=464E32CEFC406BD4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ti -Dtests.timezone=Etc/UCT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | LegacyQueryFacetCloudTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest: 
   [junit4]    >    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
   [junit4]    >         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=83, name=qtp2033452555-83, state=TIMED_WAITING, group=TGRP-LegacyQueryFacetCloudTest]
   [junit4]    >         at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2205)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    >         at java.base@10/java.lang.Thread.run(Thread.java:844)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([464E32CEFC406BD4]:0)
   [junit4] Completed [55/78 (2!)] on J1 in 65.50s, 1 test, 2 errors <<< FAILURES!

[...truncated 38113 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1395 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1395/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseConcMarkSweepGC

5 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=8610, name=jetty-launcher-1714-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)    2) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    3) Thread[id=8676, name=jetty-launcher-1714-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=8610, name=jetty-launcher-1714-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   2) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   3) Thread[id=8676, name=jetty-launcher-1714-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestHdfsBackupRestoreCore

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.handler.TestHdfsBackupRestoreCore.setupClass(TestHdfsBackupRestoreCore.java:108)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.store.hdfs.HdfsLockFactoryTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.store.hdfs.HdfsLockFactoryTest.beforeClass(HdfsLockFactoryTest.java:44)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4:B495DDAE76C0175C]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12714 lines...]
   [junit4] Suite: org.apache.solr.store.hdfs.HdfsLockFactoryTest
   [junit4]   2> 1275829 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/init-core-data-001
   [junit4]   2> 1275830 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1275831 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1276207 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1276473 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=9934447
   [junit4]   2> 1276840 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1276971 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 1276990 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1277265 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1277300 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_35555_hdfs____vi65zh/webapp
   [junit4]   2> 1278341 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:35555
   [junit4]   2> 1279120 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1279124 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1279134 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37383_datanode____.3ynhjj/webapp
   [junit4]   2> 1279634 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37383
   [junit4]   2> 1279867 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1279868 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1279880 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46207_datanode____.lmejdu/webapp
   [junit4]   2> 1280175 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:37513) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:37513
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-835536114-2a01:4f8:10b:2ab:0:0:0:2-1519138381828.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-835536114-2a01:4f8:10b:2ab:0:0:0:2-1519138381828.crc
   [junit4]   2> 	at java.net.URI.checkPath(URI.java:1823)
   [junit4]   2> 	at java.net.URI.<init>(URI.java:745)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 1280176 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:37513) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:37513
   [junit4]   2> 1280363 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46207
   [junit4]   2> 1280424 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:37513) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:37513
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-835536114-2a01:4f8:10b:2ab:0:0:0:2-1519138381828.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-835536114-2a01:4f8:10b:2ab:0:0:0:2-1519138381828.crc
   [junit4]   2> 	at java.net.URI.checkPath(URI.java:1823)
   [junit4]   2> 	at java.net.URI.<init>(URI.java:745)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 1280426 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.store.hdfs.HdfsLockFactoryTest_3CC1E274D83C7AA4-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:37513) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:37513
   [junit4]   2> 1280807 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster BPOfferService in datanode DataNode{data=null, localName='127.0.0.1:40189', datanodeUuid='null', xmitsInProgress=0} failed to connect to namenode at localhost.localdomain/127.0.0.1:37513
   [junit4]   2> 1280911 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1281912 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1282912 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1283912 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1284912 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1285913 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1286913 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1287913 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1288913 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1289914 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1290914 WARN  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 1291914 ERROR (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.h.h.MiniDFSCluster Timed out waiting for Mini HDFS Cluster to start
   [junit4]   2> 1291920 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 1292027 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 1292139 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 1292252 INFO  (SUITE-HdfsLockFactoryTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 20, 2018 2:53:17 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 64 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1878, maxMBSortInHeap=7.946137372323619, sim=RandomSimilarity(queryNorm=true): {}, locale=da-DK, timezone=America/Cambridge_Bay
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=2,free=237307952,total=324337664
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldCacheReopen, MergeStrategyTest, TestInitQParser, ShowFileRequestHandlerTest, TestStandardQParsers, TestManagedSynonymFilterFactory, TestCoreContainer, TestQuerySenderListener, TestRetrieveFieldsOptimizer, TestRebalanceLeaders, VersionInfoTest, DistributedSuggestComponentTest, TestSolrCoreProperties, DistanceFunctionTest, TestInitParams, InfoHandlerTest, TestBlobHandler, RulesTest, ResponseHeaderTest, HdfsTlogReplayBufferedWhileIndexingTest, AnalysisAfterCoreReloadTest, ConvertedLegacyTest, ZkShardTermsTest, TestStressReorder, TestJmxIntegration, CollectionsAPISolrJTest, TestOverriddenPrefixQueryForCustomFieldType, TestDFRSimilarityFactory, ExecutePlanActionTest, DirectoryFactoryTest, TestPushWriter, ConnectionManagerTest, TestOnReconnectListenerSupport, ClassificationUpdateProcessorTest, TimeZoneUtilsTest, DistributedQueueTest, DocValuesMultiTest, BigEndianAscendingWordDeserializerTest, TestCollectionsAPIViaSolrCloudCluster, TestCoreDiscovery, TriLevelCompositeIdRoutingTest, AtomicUpdatesTest, CoreAdminHandlerTest, TestExpandComponent, ResponseLogComponentTest, BasicDistributedZk2Test, TestClusterProperties, RecoveryAfterSoftCommitTest, TestSuggestSpellingConverter, TestQueryWrapperFilter, TestCloudManagedSchema, NoCacheHeaderTest, TestValueSourceCache, TestDistributedMissingSort, DocValuesTest, OverseerCollectionConfigSetProcessorTest, TestManagedSchemaThreadSafety, HdfsLockFactoryTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsLockFactoryTest -Dtests.seed=3CC1E274D83C7AA4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=da-DK -Dtests.timezone=America/Cambridge_Bay -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | HdfsLockFactoryTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
   [junit4]    > 	at org.apache.solr.store.hdfs.HdfsLockFactoryTest.beforeClass(HdfsLockFactoryTest.java:44)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [179/777 (1!)] on J2 in 19.27s, 0 tests, 1 error <<< FAILURES!

[...truncated 50 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
   [junit4]   2> 1348074 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/init-core-data-001
   [junit4]   2> 1348075 WARN  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1348075 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1348076 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1348077 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001
   [junit4]   2> 1348077 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1348077 INFO  (Thread-2171) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1348077 INFO  (Thread-2171) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1348084 ERROR (Thread-2171) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1348177 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34891
   [junit4]   2> 1348183 INFO  (zkConnectionManagerCallback-1261-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348187 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348187 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348188 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348193 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348194 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348194 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348194 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348194 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1348195 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348195 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@118e2d5{/solr,null,AVAILABLE}
   [junit4]   2> 1348195 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348195 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T01:27:37+04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1348195 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@188543f{/solr,null,AVAILABLE}
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@c423a{HTTP/1.1,[http/1.1]}{127.0.0.1:40315}
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.e.j.s.Server Started @1359269ms
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40315}
   [junit4]   2> 1348196 ERROR (jetty-launcher-1258-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@843c1{HTTP/1.1,[http/1.1]}{127.0.0.1:33689}
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-1) [    ] o.e.j.s.Server Started @1359269ms
   [junit4]   2> 1348196 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33689}
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:12.986Z
   [junit4]   2> 1348197 ERROR (jetty-launcher-1258-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348197 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:12.986Z
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1348198 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c98b46{/solr,null,AVAILABLE}
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2fedc5{HTTP/1.1,[http/1.1]}{127.0.0.1:38275}
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-6) [    ] o.e.j.s.Server Started @1359272ms
   [junit4]   2> 1348199 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38275}
   [junit4]   2> 1348200 ERROR (jetty-launcher-1258-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348200 INFO  (zkConnectionManagerCallback-1265-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348200 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348200 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348200 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348200 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:12.989Z
   [junit4]   2> 1348200 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348201 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@584855{/solr,null,AVAILABLE}
   [junit4]   2> 1348204 INFO  (zkConnectionManagerCallback-1267-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7e689a{HTTP/1.1,[http/1.1]}{127.0.0.1:40919}
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.e.j.s.Server Started @1359277ms
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40919}
   [junit4]   2> 1348205 ERROR (jetty-launcher-1258-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348205 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:12.994Z
   [junit4]   2> 1348206 INFO  (zkConnectionManagerCallback-1263-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348206 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f3f233{/solr,null,AVAILABLE}
   [junit4]   2> 1348206 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5d2c2d{HTTP/1.1,[http/1.1]}{127.0.0.1:34507}
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.e.j.s.Server Started @1359279ms
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34507}
   [junit4]   2> 1348207 ERROR (jetty-launcher-1258-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348207 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:12.996Z
   [junit4]   2> 1348211 INFO  (zkConnectionManagerCallback-1269-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348224 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348225 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1348225 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1348225 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1348227 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c3fa5{/solr,null,AVAILABLE}
   [junit4]   2> 1348227 INFO  (jetty-launcher-1258-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348228 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@b5826e{HTTP/1.1,[http/1.1]}{127.0.0.1:36159}
   [junit4]   2> 1348229 INFO  (jetty-launcher-1258-thread-4) [    ] o.e.j.s.Server Started @1359302ms
   [junit4]   2> 1348229 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36159}
   [junit4]   2> 1348229 ERROR (jetty-launcher-1258-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1348229 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1348230 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1348230 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1348230 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T14:54:13.019Z
   [junit4]   2> 1348230 INFO  (zkConnectionManagerCallback-1271-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348231 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348232 INFO  (zkConnectionManagerCallback-1277-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348232 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1348241 INFO  (zkConnectionManagerCallback-1275-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348250 INFO  (jetty-launcher-1258-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348254 INFO  (jetty-launcher-1258-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348254 INFO  (jetty-launcher-1258-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348254 INFO  (jetty-launcher-1258-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348258 INFO  (jetty-launcher-1258-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34891/solr
   [junit4]   2> 1348259 INFO  (zkConnectionManagerCallback-1290-thread-1-processing-n:127.0.0.1:33689_solr) [n:127.0.0.1:33689_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348263 INFO  (zkConnectionManagerCallback-1299-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348263 INFO  (zkConnectionManagerCallback-1285-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348263 INFO  (zkConnectionManagerCallback-1293-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348264 INFO  (zkConnectionManagerCallback-1297-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348266 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100715850fc000d, likely client has closed socket
   [junit4]   2> 1348269 INFO  (zkConnectionManagerCallback-1295-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348273 INFO  (zkConnectionManagerCallback-1305-thread-1-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348273 INFO  (zkConnectionManagerCallback-1304-thread-1-processing-n:127.0.0.1:34507_solr) [n:127.0.0.1:34507_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348277 INFO  (zkConnectionManagerCallback-1307-thread-1-processing-n:127.0.0.1:40315_solr) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348285 INFO  (zkConnectionManagerCallback-1306-thread-1-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348285 INFO  (zkConnectionManagerCallback-1309-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1348308 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348308 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38275_solr
   [junit4]   2> 1348312 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.c.Overseer Overseer (id=72182218167681042-127.0.0.1:38275_solr-n_0000000000) starting
   [junit4]   2> 1348322 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38275_solr
   [junit4]   2> 1348323 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1348382 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1348383 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1348384 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348385 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348386 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36159_solr
   [junit4]   2> 1348387 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1348388 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40315_solr
   [junit4]   2> 1348393 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1348398 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1348403 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1348403 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348405 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40919_solr
   [junit4]   2> 1348405 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1348410 INFO  (zkCallback-1302-thread-1-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
   [junit4]   2> 1348417 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1348419 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348420 INFO  (zkCallback-1301-thread-1-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1348421 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1348422 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34507_solr
   [junit4]   2> 1348422 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1348433 INFO  (zkCallback-1303-thread-1-processing-n:127.0.0.1:40315_solr) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (5)
   [junit4]   2> 1348434 INFO  (zkCallback-1302-thread-1-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1348434 INFO  (zkCallback-1301-thread-1-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1348435 INFO  (zkCallback-1300-thread-1-processing-n:127.0.0.1:34507_solr) [n:127.0.0.1:34507_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1348436 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33689_solr
   [junit4]   2> 1348454 INFO  (zkCallback-1301-thread-1-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1348454 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1348454 INFO  (zkCallback-1302-thread-1-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1348454 INFO  (zkCallback-1289-thread-1-processing-n:127.0.0.1:33689_solr) [n:127.0.0.1:33689_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (6)
   [junit4]   2> 1348454 INFO  (zkCallback-1300-thread-1-processing-n:127.0.0.1:34507_solr) [n:127.0.0.1:34507_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1348455 INFO  (zkCallback-1303-thread-1-processing-n:127.0.0.1:40315_solr) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 1348557 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40919.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348591 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40919.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348591 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40919.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348593 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40315.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348596 INFO  (jetty-launcher-1258-thread-3) [n:127.0.0.1:40919_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node3/.
   [junit4]   2> 1348601 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38275.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348625 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34507.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348632 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36159.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348632 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38275.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348633 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38275.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348633 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40315.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348633 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40315.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348635 INFO  (jetty-launcher-1258-thread-6) [n:127.0.0.1:38275_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node6/.
   [junit4]   2> 1348635 INFO  (jetty-launcher-1258-thread-2) [n:127.0.0.1:40315_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node2/.
   [junit4]   2> 1348639 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33689.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348646 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34507.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348646 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34507.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348660 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36159.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348660 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36159.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348660 INFO  (jetty-launcher-1258-thread-5) [n:127.0.0.1:34507_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node5/.
   [junit4]   2> 1348662 INFO  (jetty-launcher-1258-thread-4) [n:127.0.0.1:36159_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node4/.
   [junit4]   2> 1348665 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33689.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348666 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33689.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d4eb1c
   [junit4]   2> 1348667 INFO  (jetty-launcher-1258-thread-1) [n:127.0.0.1:33689_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_3CC1E274D83C7AA4-001/tempDir-001/node1/.
   [junit4]   2> 1349077 INFO  (zkConnectionManagerCallback-1323-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349078 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100715850fc0013, likely client has closed socket
   [junit4]   2> 1349080 INFO  (zkConnectionManagerCallback-1327-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349081 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 1349082 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[3CC1E274D83C7AA4]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34891/solr ready
   [junit4]   2> 1349115 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[3CC1E274D83C7AA4]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1349116 INFO  (zkConnectionManagerCallback-1329-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349118 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[3CC1E274D83C7AA4]) [    ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
   [junit4]   2> 1349123 INFO  (qtp21786359-6675) [n:127.0.0.1:33689_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349139 INFO  (qtp23114789-6678) [n:127.0.0.1:34507_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349143 INFO  (qtp22235180-6708) [n:127.0.0.1:36159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349146 INFO  (qtp27644318-6711) [n:127.0.0.1:38275_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349149 INFO  (qtp28897462-6668) [n:127.0.0.1:40315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349153 INFO  (qtp16538727-6672) [n:127.0.0.1:40919_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349154 INFO  (qtp27644318-6689) [n:127.0.0.1:38275_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=34
   [junit4]   2> 1349158 INFO  (qtp16538727-6714) [n:127.0.0.1:40919_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1349160 INFO  (OverseerThreadFactory-2540-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
   [junit4]   2> 1349162 INFO  (qtp21786359-6691) [n:127.0.0.1:33689_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349165 INFO  (qtp23114789-6693) [n:127.0.0.1:34507_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349167 INFO  (qtp22235180-6735) [n:127.0.0.1:36159_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349169 INFO  (qtp27644318-6710) [n:127.0.0.1:38275_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349171 INFO  (qtp28897462-6679) [n:127.0.0.1:40315_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349173 INFO  (qtp16538727-6699) [n:127.0.0.1:40919_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1349186 INFO  (OverseerThreadFactory-2540-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1901614413 sessionWrapper.createTime 1901614400793070, this.sessionWrapper.createTime 1901614400793070 
   [junit4]   2> 1349292 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349293 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33689/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349294 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33689/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349296 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40315/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349297 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38275/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349298 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36159/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349299 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n12",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40919/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349301 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n14",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349302 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n16",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349303 INFO  (OverseerStateUpdate-72182218167681042-127.0.0.1:38275_solr-n_0000000000) [n:127.0.0.1:38275_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n18",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36159/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1349511 INFO  (qtp23114789-6702) [n:127.0.0.1:34507_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n16&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349511 INFO  (qtp21786359-6698) [n:127.0.0.1:33689_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n4&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349511 INFO  (qtp28897462-6679) [n:127.0.0.1:40315_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n6&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349513 INFO  (qtp23114789-6687) [n:127.0.0.1:34507_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n1&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349513 INFO  (qtp21786359-6682) [n:127.0.0.1:33689_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n2&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349514 INFO  (qtp21786359-6682) [n:127.0.0.1:33689_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349514 INFO  (qtp23114789-6687) [n:127.0.0.1:34507_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349514 INFO  (qtp28897462-6679) [n:127.0.0.1:40315_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349519 INFO  (qtp16538727-6705) [n:127.0.0.1:40919_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n12&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349519 INFO  (qtp22235180-6735) [n:127.0.0.1:36159_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n10&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349520 INFO  (qtp16538727-6705) [n:127.0.0.1:40919_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349520 INFO  (qtp22235180-6735) [n:127.0.0.1:36159_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349521 INFO  (qtp27644318-6710) [n:127.0.0.1:38275_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n8&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349521 INFO  (qtp22235180-6736) [n:127.0.0.1:36159_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node20&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n18&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349522 INFO  (qtp27644318-6710) [n:127.0.0.1:38275_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1349525 INFO  (qtp23114789-6855) [n:127.0.0.1:34507_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node17&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n14&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349642 INFO  (zkCallback-1303-thread-1-processing-n:127.0.0.1:40315_solr) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349642 INFO  (zkCallback-1289-thread-1-processing-n:127.0.0.1:33689_solr) [n:127.0.0.1:33689_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349642 INFO  (zkCallback-1301-thread-2-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349642 INFO  (zkCallback-1302-thread-1-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349642 INFO  (zkCallback-1301-thread-1-processing-n:127.0.0.1:40919_solr) [n:127.0.0.1:40919_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349643 INFO  (zkCallback-1308-thread-1-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349643 INFO  (zkCallback-1300-thread-1-processing-n:127.0.0.1:34507_solr) [n:127.0.0.1:34507_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349643 INFO  (zkCallback-1302-thread-2-processing-n:127.0.0.1:36159_solr) [n:127.0.0.1:36159_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349643 INFO  (zkCallback-1303-thread-2-processing-n:127.0.0.1:40315_solr) [n:127.0.0.1:40315_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349643 INFO  (zkCallback-1289-thread-2-processing-n:127.0.0.1:33689_solr) [n:127.0.0.1:33689_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1349644 INFO  (zkCallback-1308-thread-2-processing-n:127.0.0.1:38275_solr) [n:127.0.0.1:38275_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 1350539 INFO  (qtp28897462-6679) [n:127.0.0.1:40315_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350539 INFO  (qtp21786359-6698) [n:127.0.0.1:33689_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350544 INFO  (qtp22235180-6736) [n:127.0.0.1:36159_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350545 INFO  (qtp16538727-6705) [n:127.0.0.1:40919_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350548 INFO  (qtp23114789-6687) [n:127.0.0.1:34507_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350549 INFO  (qtp22235180-6735) [n:127.0.0.1:36159_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350584 INFO  (qtp23114789-6855) [n:127.0.0.1:34507_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350585 INFO  (qtp21786359-6682) [n:127.0.0.1:33689_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350586 INFO  (qtp27644318-6710) [n:127.0.0.1:38275_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350587 INFO  (qtp23114789-6702) [n:127.0.0.1:34507_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350602 INFO  (qtp27644318-6710) [n:127.0.0.1:38275_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n8] Schema name=cloud-dynamic
   [junit4]   2> 1350602 INFO  (qtp16538727-6705) [n:127.0.0.1:40919_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n12] Schema name=cloud-dynamic
   [junit4]   2> 1350602 INFO  (qtp21786359-6682) [n:127.0.0.1:33689_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n2] Schema name=cloud-dynamic
   [junit4]   2> 1350613 INFO  (qtp23114789-6855) [n:127.0.0.1:34507_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n14] Schema name

[...truncated too long message...]

Thread.sleep(Native Method)
   [junit4]   2> 	at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]   2> 1845190 WARN  (jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105)) [n:127.0.0.1:37511_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> Feb 20, 2018 3:02:30 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=2032, maxMBSortInHeap=6.516512478092514, sim=RandomSimilarity(queryNorm=false): {}, locale=th-TH, timezone=Chile/EasterIsland
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=4,free=97364256,total=372908032
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldCacheReopen, MergeStrategyTest, TestInitQParser, ShowFileRequestHandlerTest, TestStandardQParsers, TestManagedSynonymFilterFactory, TestCoreContainer, TestQuerySenderListener, TestRetrieveFieldsOptimizer, TestRebalanceLeaders, VersionInfoTest, DistributedSuggestComponentTest, TestSolrCoreProperties, DistanceFunctionTest, TestInitParams, InfoHandlerTest, TestBlobHandler, RulesTest, ResponseHeaderTest, HdfsTlogReplayBufferedWhileIndexingTest, AnalysisAfterCoreReloadTest, ConvertedLegacyTest, ZkShardTermsTest, TestStressReorder, TestJmxIntegration, CollectionsAPISolrJTest, TestOverriddenPrefixQueryForCustomFieldType, TestDFRSimilarityFactory, ExecutePlanActionTest, DirectoryFactoryTest, TestPushWriter, ConnectionManagerTest, TestOnReconnectListenerSupport, ClassificationUpdateProcessorTest, TimeZoneUtilsTest, DistributedQueueTest, DocValuesMultiTest, BigEndianAscendingWordDeserializerTest, TestCollectionsAPIViaSolrCloudCluster, TestCoreDiscovery, TriLevelCompositeIdRoutingTest, AtomicUpdatesTest, CoreAdminHandlerTest, TestExpandComponent, ResponseLogComponentTest, BasicDistributedZk2Test, TestClusterProperties, RecoveryAfterSoftCommitTest, TestSuggestSpellingConverter, TestQueryWrapperFilter, TestCloudManagedSchema, NoCacheHeaderTest, TestValueSourceCache, TestDistributedMissingSort, DocValuesTest, OverseerCollectionConfigSetProcessorTest, TestManagedSchemaThreadSafety, HdfsLockFactoryTest, DistributedSpellCheckComponentTest, TestCodecSupport, TestReplicaProperties, TestNumericTerms32, TestDistribDocBasedVersion, CircularListTest, NumericFieldsTest, TestSolrDeletionPolicy2, MigrateRouteKeyTest, TestFreeTextSuggestions, TestCorePropertiesReload, TestFieldTypeCollectionResource, TestDynamicFieldResource, TestCloudPseudoReturnFields, V2ApiIntegrationTest, DeleteInactiveReplicaTest, TestHdfsBackupRestoreCore, TestSegmentSorting, TestAnalyzedSuggestions, BlockDirectoryTest, ClusterStateUpdateTest, CdcrVersionReplicationTest, DistributedFacetPivotLongTailTest, TestLazyCores, TestSolrCloudWithSecureImpersonation]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=3CC1E274D83C7AA4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th-TH -Dtests.timezone=Chile/EasterIsland -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | TestSolrCloudWithSecureImpersonation (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]    >    1) Thread[id=8610, name=jetty-launcher-1714-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]    >    2) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    >    3) Thread[id=8676, name=jetty-launcher-1714-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=8675, name=jetty-launcher-1714-thread-2-SendThread(127.0.0.1:34105), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3CC1E274D83C7AA4]:0)
   [junit4] Completed [266/777 (4!)] on J2 in 53.73s, 12 tests, 2 errors <<< FAILURES!

[...truncated 10911 lines...]
-validate-source-patterns:
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/collector/SolrCollector.java
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/exporter/SolrExporter.java
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/scraper/SolrScraper.java

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:618: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:128: Found 3 violations in source files (invalid logging pattern [not private static final, uses static class name]).

Total time: 90 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1394 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1394/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([9A40968B823884EA:F7BC327638707BED]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:241)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14202 lines...]
   [junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/init-core-data-001
   [junit4]   2> 2695523 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2695524 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2695524 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2695525 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001
   [junit4]   2> 2695525 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2695525 INFO  (Thread-7747) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2695525 INFO  (Thread-7747) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2695526 ERROR (Thread-7747) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2695625 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46603
   [junit4]   2> 2695627 INFO  (zkConnectionManagerCallback-4411-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695632 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2695633 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2695633 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2695635 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2695636 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2695636 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29250f{/solr,null,AVAILABLE}
   [junit4]   2> 2695636 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2695636 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c67f81{/solr,null,AVAILABLE}
   [junit4]   2> 2695637 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2695637 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1354a44{/solr,null,AVAILABLE}
   [junit4]   2> 2695638 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@268a7c{SSL,[ssl, http/1.1]}{127.0.0.1:34895}
   [junit4]   2> 2695638 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d2e79b{SSL,[ssl, http/1.1]}{127.0.0.1:42229}
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.e.j.s.Server Started @2697602ms
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.e.j.s.Server Started @2697602ms
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34895}
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42229}
   [junit4]   2> 2695638 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@189a2a0{SSL,[ssl, http/1.1]}{127.0.0.1:34115}
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.e.j.s.Server Started @2697602ms
   [junit4]   2> 2695639 ERROR (jetty-launcher-4408-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2695639 ERROR (jetty-launcher-4408-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T12:11:47.661Z
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T12:11:47.661Z
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34115}
   [junit4]   2> 2695639 ERROR (jetty-launcher-4408-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 7.3.0
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2695639 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-20T12:11:47.661Z
   [junit4]   2> 2695640 INFO  (zkConnectionManagerCallback-4414-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695640 INFO  (zkConnectionManagerCallback-4415-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695640 INFO  (zkConnectionManagerCallback-4417-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695640 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2695640 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2695641 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2695647 INFO  (jetty-launcher-4408-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46603/solr
   [junit4]   2> 2695647 INFO  (jetty-launcher-4408-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46603/solr
   [junit4]   2> 2695648 INFO  (jetty-launcher-4408-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46603/solr
   [junit4]   2> 2695648 INFO  (zkConnectionManagerCallback-4424-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695649 INFO  (zkConnectionManagerCallback-4427-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695649 INFO  (zkConnectionManagerCallback-4429-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695651 INFO  (zkConnectionManagerCallback-4431-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695657 INFO  (zkConnectionManagerCallback-4433-thread-1-processing-n:127.0.0.1:42229_solr) [n:127.0.0.1:42229_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695657 INFO  (zkConnectionManagerCallback-4435-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695711 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34895_solr
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34115_solr
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42229_solr
   [junit4]   2> 2695712 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer Overseer (id=72181579498192905-127.0.0.1:34895_solr-n_0000000000) starting
   [junit4]   2> 2695724 INFO  (zkCallback-4434-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2695725 INFO  (zkCallback-4432-thread-1-processing-n:127.0.0.1:42229_solr) [n:127.0.0.1:42229_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2695725 INFO  (zkCallback-4430-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2695730 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2695733 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 2695734 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 2695734 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34895_solr
   [junit4]   2> 2695734 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34115_solr, 127.0.0.1:42229_solr]
   [junit4]   2> 2695734 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 2695734 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 2695734 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:34895_solr"} current state version: 0
   [junit4]   2> 2695734 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:34895_solr
   [junit4]   2> 2695734 INFO  (zkCallback-4434-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2695734 INFO  (zkCallback-4432-thread-1-processing-n:127.0.0.1:42229_solr) [n:127.0.0.1:42229_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2695735 INFO  (zkCallback-4430-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2695740 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2695740 DEBUG (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 2695740 DEBUG (ScheduledTrigger-7829-thread-1) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 2695795 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42229.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695804 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42229.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695804 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42229.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695805 INFO  (jetty-launcher-4408-thread-2) [n:127.0.0.1:42229_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/.
   [junit4]   2> 2695848 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695857 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695857 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695858 INFO  (jetty-launcher-4408-thread-1) [n:127.0.0.1:34115_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/.
   [junit4]   2> 2695953 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34895.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695960 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34895.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695960 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34895.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2695961 INFO  (jetty-launcher-4408-thread-3) [n:127.0.0.1:34895_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/.
   [junit4]   2> 2695990 INFO  (zkConnectionManagerCallback-4443-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695993 INFO  (zkConnectionManagerCallback-4447-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2695994 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2695994 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46603/solr ready
   [junit4]   2> 2696039 INFO  (qtp6566519-23475) [n:127.0.0.1:42229_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2696040 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 2696040 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
   [junit4]   2> 2696041 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 2696042 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
   [junit4]   2> 2696043 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
   [junit4]   2> 2696043 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
   [junit4]   2> 2696044 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 2696044 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 2696045 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 2696045 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 2696046 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 2696047 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 2696047 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 2696048 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 2696049 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 2696049 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 2696050 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 2696050 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 2696051 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 2696051 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 2696052 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 2696053 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 2696053 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 2696054 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 2696054 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 2696055 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 2696055 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 2696056 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 2696057 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 2696057 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 2696058 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 2696058 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 2696059 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 2696059 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 2696060 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 2696061 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 2696061 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 2696062 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 2696062 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 2696063 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 2696064 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 2696064 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 2696065 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 2696065 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 2696066 INFO  (OverseerThreadFactory-7831-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
   [junit4]   2> 2696068 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 2696068 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 2696069 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 2696170 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2696170 INFO  (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2696171 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 2696171 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2696171 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2696172 INFO  (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2696173 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2696173 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2696174 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2696174 INFO  (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2696174 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2696174 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>       "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2696275 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
   [junit4]   2> 2696395 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n4&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2696395 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2696401 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>   "node_name":"127.0.0.1:42229_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2696401 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>   "node_name":"127.0.0.1:42229_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2696401 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4","base_url":"https://127.0.0.1:42229/solr","node_name":"127.0.0.1:42229_solr","state":"down","type":"NRT"}
   [junit4]   2> 2696401 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>           "node_name":"127.0.0.1:42229_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2696426 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2696426 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2696427 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34895_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2696428 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34895_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2696428 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:34895/solr","node_name":"127.0.0.1:34895_solr","state":"down","type":"NRT"}
   [junit4]   2> 2696428 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>           "node_name":"127.0.0.1:34895_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>           "node_name":"127.0.0.1:42229_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2696438 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2696438 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2696440 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34115_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2696440 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34115_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2696440 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:34115/solr","node_name":"127.0.0.1:34115_solr","state":"down","type":"NRT"}
   [junit4]   2> 2696440 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:34895/solr",
   [junit4]   2>           "node_name":"127.0.0.1:34895_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:34115/solr",
   [junit4]   2>           "node_name":"127.0.0.1:34115_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:42229/solr",
   [junit4]   2>           "node_name":"127.0.0.1:42229_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2696541 DEBUG (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
   [junit4]   2> 2696541 INFO  (zkCallback-4430-thread-1-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696541 INFO  (zkCallback-4434-thread-1-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696541 INFO  (zkCallback-4432-thread-1-processing-n:127.0.0.1:42229_solr) [n:127.0.0.1:42229_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696548 INFO  (zkCallback-4432-thread-2-processing-n:127.0.0.1:42229_solr) [n:127.0.0.1:42229_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696549 INFO  (zkCallback-4434-thread-2-processing-n:127.0.0.1:34895_solr) [n:127.0.0.1:34895_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696552 INFO  (zkCallback-4430-thread-2-processing-n:127.0.0.1:34115_solr) [n:127.0.0.1:34115_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2696741 DEBUG (ScheduledTrigger-7829-thread-1) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 2697407 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2697407 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2697408 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib
   [junit4]   2> 2697409 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2697409 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib
   [junit4]   2> 2697409 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2697409 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/langid/lib
   [junit4]   2> 2697409 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2697410 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/velocity/lib
   [junit4]   2> 2697410 WARN  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2697429 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2697432 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2697432 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2697433 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 2697433 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
   [junit4]   2> 2697433 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 2697433 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
   [junit4]   2> 2697433 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 2697434 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
   [junit4]   2> 2697436 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 2697436 WARN  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../dist
   [junit4]   2> 2697444 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2697448 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2697448 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2697449 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
   [junit4]   2> 2697449 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2697449 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
   [junit4]   2> 2697449 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2697450 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
   [junit4]   2> 2697450 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] Schema name=default-config
   [junit4]   2> 2697450 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2697450 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib
   [junit4]   2> 2697450 WARN  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2697459 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2697504 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 2697512 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.s.IndexSchema [AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] Schema name=default-config
   [junit4]   2> 2697690 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2697691 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2697724 INFO  (qtp23241913-23483) [n:127.0.0.1:34895_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2697726 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'AutoscalingHistoryHandlerTest_collection_shard1_replica_n2' using configuration from collection AutoscalingHistoryHandlerTest_collection, trusted=true
   [junit4]   2> 2697727 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34115.solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n2' (registry 'solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2697727 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2697727 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrCore [[AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node1/./AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/data/]
   [junit4]   2> 2697730 INFO  (qtp11434160-23471) [n:127.0.0.1:34115_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 2697731 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'AutoscalingHistoryHandlerTest_collection_shard1_replica_n4' using configuration from collection AutoscalingHistoryHandlerTest_collection, trusted=true
   [junit4]   2> 2697732 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42229.solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n4' (registry 'solr.core.AutoscalingHistoryHandlerTest_collection.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21156a
   [junit4]   2> 2697732 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2697732 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrCore [[AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001/tempDir-001/node2/./AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/data/]
   [junit4]   2> 2697738 INFO  (qtp6566519-23477) [n:127.0.0.1:42229_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 2697742 DEBUG (ScheduledTrigger-7829-thread-2) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [j

[...truncated too long message...]

it4]   2> 2708815 INFO  (jetty-closer-4409-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2708815 INFO  (coreCloseExecutor-7877-thread-2) [n:127.0.0.1:34895_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=32234433
   [junit4]   2> 2708817 INFO  (jetty-closer-4409-thread-3) [    ] o.a.s.c.Overseer Overseer (id=72181579498192905-127.0.0.1:34895_solr-n_0000000000) closing
   [junit4]   2> 2708817 INFO  (OverseerStateUpdate-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34895_solr
   [junit4]   2> 2708817 WARN  (OverseerAutoScalingTriggerThread-72181579498192905-127.0.0.1:34895_solr-n_0000000000) [n:127.0.0.1:34895_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2708817 DEBUG (jetty-closer-4409-thread-3) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 2708818 INFO  (jetty-closer-4409-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1354a44{/solr,null,UNAVAILABLE}
   [junit4]   2> 2708818 INFO  (jetty-closer-4409-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2710290 WARN  (zkCallback-4454-thread-1-processing-n:127.0.0.1:42873_solr) [n:127.0.0.1:42873_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2710290 INFO  (jetty-closer-4409-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1dcf792{/solr,null,UNAVAILABLE}
   [junit4]   2> 2710291 INFO  (jetty-closer-4409-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2710291 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2710291 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[9A40968B823884EA]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46603 46603
   [junit4]   2> 2710315 INFO  (Thread-7747) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46603 46603
   [junit4]   2> 2710316 WARN  (Thread-7747) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/aliases.json
   [junit4]   2> 	10	/solr/collections/AutoscalingHistoryHandlerTest_collection/terms/shard1
   [junit4]   2> 	9	/solr/collections/.system/terms/shard1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	3	/solr/configs/.system
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED
   [junit4]   2> 	3	/solr/configs/.system/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/collections/.system/state.json
   [junit4]   2> 	22	/solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 	11	/solr/clusterprops.json
   [junit4]   2> 	11	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/live_nodes
   [junit4]   2> 	11	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_9A40968B823884EA-001
   [junit4]   2> Feb 20, 2018 12:12:02 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-BO, timezone=Europe/Guernsey
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=123897928,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [HttpPartitionOnCommitTest, TestUniqueKeyFieldResource, SegmentsInfoRequestHandlerTest, RAMDirectoryFactoryTest, HighlighterConfigTest, ZkNodePropsTest, TestCustomDocTransformer, XmlUpdateRequestHandlerTest, TestSimpleQParserPlugin, TestPKIAuthenticationPlugin, TestClusterStateMutator, TestInPlaceUpdatesStandalone, DeleteLastCustomShardedReplicaTest, StatsComponentTest, ReplicationFactorTest, TestXmlQParserPlugin, TestPrepRecovery, TestManagedResourceStorage, PeerSyncWithIndexFingerprintCachingTest, SolrCoreCheckLockOnStartupTest, TestHighlightDedupGrouping, HdfsRecoverLeaseTest, TestDistributedMap, TestMultiWordSynonyms, TestRTimerTree, PreAnalyzedFieldManagedSchemaCloudTest, TestHashPartitioner, ResponseBuilderTest, TestFieldCollectionResource, SynonymTokenizerTest, TestZkAclsWithHadoopAuth, TestFieldCacheWithThreads, TestDocumentBuilder, TestSolrQueryParser, SpellCheckCollatorTest, TestExceedMaxTermLength, SolrCLIZkUtilsTest, DistributedVersionInfoTest, TestSchemaSimilarityResource, MissingSegmentRecoveryTest, BigEndianAscendingWordSerializerTest, TestFastOutputStream, CdcrReplicationHandlerTest, HdfsUnloadDistributedZkTest, TestGraphTermsQParserPlugin, FullSolrCloudDistribCmdsTest, TestCopyFieldCollectionResource, RequestHandlersTest, AddSchemaFieldsUpdateProcessorFactoryTest, ZkSolrClientTest, TestIndexingPerformance, ClassificationUpdateProcessorFactoryTest, SolrIndexConfigTest, TestSimpleTextCodec, TestPseudoReturnFields, UpdateParamsTest, ConjunctionSolrSpellCheckerTest, ChaosMonkeyNothingIsSafeTest, DistribDocExpirationUpdateProcessorTest, TestCryptoKeys, TestSimDistributedQueue, SolrCoreMetricManagerTest, ShardRoutingTest, TestLeaderElectionWithEmptyReplica, SolrIndexSplitterTest, TestCloudRecovery, HdfsChaosMonkeyNothingIsSafeTest, ImplicitSnitchTest, TestTlogReplica, TestBackupRepositoryFactory, ExitableDirectoryReaderTest, RemoteQueryErrorTest, TestRawResponseWriter, TestSolrCloudSnapshots, DebugComponentTest, DistributedFacetPivotSmallAdvancedTest, TestPhraseSuggestions, HdfsSyncSliceTest, TestPayloadCheckQParserPlugin, TestSortByMinMaxFunction, TestSortableTextField, TestLegacyNumericUtils, TestCustomSort, BufferStoreTest, TestCrossCoreJoin, BinaryUpdateRequestHandlerTest, NodeAddedTriggerTest, TestWriterPerf, ChangedSchemaMergeTest, TestScoreJoinQPScore, AnalyticsMergeStrategyTest, TestLuceneIndexBackCompat, ZkCLITest, SolrJmxReporterCloudTest, CursorMarkTest, TestRandomCollapseQParserPlugin, TestLockTree, SuggestComponentTest, TestDocSet, TestCollationField, UtilsToolTest, TestStressLucene, OverseerTaskQueueTest, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, SimpleMLTQParserTest, TestShortCircuitedRequests, LeaderInitiatedRecoveryOnShardRestartTest, TestCSVLoader, TemplateUpdateProcessorTest, ExternalFileFieldSortTest, MetricsHandlerTest, TestAuthenticationFramework, TestQuerySenderNoQuery, AssignTest, TestSolrCloudWithDelegationTokens, TestRecoveryHdfs, TestSolrDeletionPolicy1, BlobRepositoryCloudTest, TestLMDirichletSimilarityFactory, CdcrBidirectionalTest, CustomHighlightComponentTest, HdfsAutoAddReplicasIntegrationTest, TestNRTOpen, CoreAdminRequestStatusTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, TestRandomFaceting, TestDistributedSearch, TestDistributedGrouping, TestRecovery, TestStressReorder, TestJoin, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, DirectUpdateHandlerTest, SoftAutoCommitTest, ChaosMonkeySafeLeaderWithPullReplicasTest, ConfigSetsAPITest, CreateRoutedAliasTest, DeleteShardTest, DistributedQueueTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, MoveReplicaHDFSFailoverTest, MoveReplicaTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, TestCloudJSONFacetJoinDomain, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestMiniSolrCloudClusterSSL, TestRequestForwarding, TestSSLRandomization, TestStressCloudBlindAtomicUpdates, TestTolerantUpdateProcessorCloud, TestUtilizeNode, ZkShardTermsTest, CollectionsAPIAsyncDistributedZkTest, TestHdfsCloudBackupRestore, AutoAddReplicasPlanActionTest, SystemLogListenerTest, TriggerIntegrationTest, TestDynamicLoading, TestCoreBackup, TestHdfsBackupRestoreCore, V2ApiIntegrationTest, V2StandaloneTest, AutoscalingHistoryHandlerTest]
   [junit4] Completed [633/777 (1!)] on J0 in 15.07s, 1 test, 1 failure <<< FAILURES!

[...truncated 9800 lines...]
-validate-source-patterns:
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/collector/SolrCollector.java
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/exporter/SolrExporter.java
[source-patterns] invalid logging pattern [not private static final, uses static class name]: solr/contrib/prometheus-exporter/src/java/org/apache/solr/prometheus/scraper/SolrScraper.java

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:618: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:128: Found 3 violations in source files (invalid logging pattern [not private static final, uses static class name]).

Total time: 83 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any