You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/05/08 13:43:51 UTC

[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1843 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1843/

3 tests failed.
FAILED:  org.apache.solr.security.JWTAuthPluginIntegrationTest.createCollectionUpdateAndQueryDistributed

Error Message:
Expected metric minimums for prefix SECURITY./authentication/pki.: {failMissingCredentials=0, authenticated=12, passThrough=0, failWrongCredentials=0, requests=12, errors=0}, but got: {failMissingCredentials=0, authenticated=4, passThrough=0, totalTime=3804171, failWrongCredentials=0, requestTimes=428, requests=4, errors=0}

Stack Trace:
java.lang.AssertionError: Expected metric minimums for prefix SECURITY./authentication/pki.: {failMissingCredentials=0, authenticated=12, passThrough=0, failWrongCredentials=0, requests=12, errors=0}, but got: {failMissingCredentials=0, authenticated=4, passThrough=0, totalTime=3804171, failWrongCredentials=0, requestTimes=428, requests=4, errors=0}
	at __randomizedtesting.SeedInfo.seed([3B1597EDEE2B1697:3D3D95838C9C8024]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.SolrCloudAuthTestCase.assertAuthMetricsMinimums(SolrCloudAuthTestCase.java:129)
	at org.apache.solr.cloud.SolrCloudAuthTestCase.assertPkiAuthMetricsMinimums(SolrCloudAuthTestCase.java:74)
	at org.apache.solr.security.JWTAuthPluginIntegrationTest.createCollectionUpdateAndQueryDistributed(JWTAuthPluginIntegrationTest.java:173)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.security.hadoop.TestSolrCloudWithHadoopAuthPlugin.testBasics

Error Message:
Expected metric minimums for prefix SECURITY./authentication.: {failMissingCredentials=0, authenticated=8, passThrough=0, failWrongCredentials=8, requests=16, errors=0}, but got: {failMissingCredentials=0, authenticated=8, passThrough=0, totalTime=37052376, failWrongCredentials=6, requestTimes=3348, requests=14, errors=0}

Stack Trace:
java.lang.AssertionError: Expected metric minimums for prefix SECURITY./authentication.: {failMissingCredentials=0, authenticated=8, passThrough=0, failWrongCredentials=8, requests=16, errors=0}, but got: {failMissingCredentials=0, authenticated=8, passThrough=0, totalTime=37052376, failWrongCredentials=6, requestTimes=3348, requests=14, errors=0}
	at __randomizedtesting.SeedInfo.seed([3B1597EDEE2B1697:6CD39C1D6C548E7]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.SolrCloudAuthTestCase.assertAuthMetricsMinimums(SolrCloudAuthTestCase.java:129)
	at org.apache.solr.cloud.SolrCloudAuthTestCase.assertAuthMetricsMinimums(SolrCloudAuthTestCase.java:83)
	at org.apache.solr.security.hadoop.TestSolrCloudWithHadoopAuthPlugin.testCollectionCreateSearchDelete(TestSolrCloudWithHadoopAuthPlugin.java:139)
	at org.apache.solr.security.hadoop.TestSolrCloudWithHadoopAuthPlugin.testBasics(TestSolrCloudWithHadoopAuthPlugin.java:108)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple2 Timeout waiting to see state for collection=testSimple2 :DocCollection(testSimple2//collections/testSimple2/state.json/23)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/",           "base_url":"http://127.0.0.1:34924/solr",           "node_name":"127.0.0.1:34924_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/tlog",           "core":"testSimple2_shard1_replica_n1",           "shared_storage":"true",           "state":"down"},         "core_node4":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/",           "base_url":"http://127.0.0.1:36587/solr",           "node_name":"127.0.0.1:36587_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/tlog",           "core":"testSimple2_shard1_replica_n2",           "shared_storage":"true",           "state":"active",           "leader":"true"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node6":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/",           "base_url":"http://127.0.0.1:34924/solr",           "node_name":"127.0.0.1:34924_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/tlog",           "core":"testSimple2_shard2_replica_n5",           "shared_storage":"true",           "state":"down"},         "core_node8":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/",           "base_url":"http://127.0.0.1:36587/solr",           "node_name":"127.0.0.1:36587_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/tlog",           "core":"testSimple2_shard2_replica_n7",           "shared_storage":"true",           "state":"active",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"} Live Nodes: [127.0.0.1:36587_solr, 127.0.0.1:45575_solr] Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/23)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/",           "base_url":"http://127.0.0.1:34924/solr",           "node_name":"127.0.0.1:34924_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/tlog",           "core":"testSimple2_shard1_replica_n1",           "shared_storage":"true",           "state":"down"},         "core_node4":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/",           "base_url":"http://127.0.0.1:36587/solr",           "node_name":"127.0.0.1:36587_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/tlog",           "core":"testSimple2_shard1_replica_n2",           "shared_storage":"true",           "state":"active",           "leader":"true"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node6":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/",           "base_url":"http://127.0.0.1:34924/solr",           "node_name":"127.0.0.1:34924_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/tlog",           "core":"testSimple2_shard2_replica_n5",           "shared_storage":"true",           "state":"down"},         "core_node8":{           "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/",           "base_url":"http://127.0.0.1:36587/solr",           "node_name":"127.0.0.1:36587_solr",           "type":"NRT",           "force_set_state":"false",           "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/tlog",           "core":"testSimple2_shard2_replica_n7",           "shared_storage":"true",           "state":"active",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple2
Timeout waiting to see state for collection=testSimple2 :DocCollection(testSimple2//collections/testSimple2/state.json/23)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/",
          "base_url":"http://127.0.0.1:34924/solr",
          "node_name":"127.0.0.1:34924_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/tlog",
          "core":"testSimple2_shard1_replica_n1",
          "shared_storage":"true",
          "state":"down"},
        "core_node4":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/",
          "base_url":"http://127.0.0.1:36587/solr",
          "node_name":"127.0.0.1:36587_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/tlog",
          "core":"testSimple2_shard1_replica_n2",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node6":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/",
          "base_url":"http://127.0.0.1:34924/solr",
          "node_name":"127.0.0.1:34924_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/tlog",
          "core":"testSimple2_shard2_replica_n5",
          "shared_storage":"true",
          "state":"down"},
        "core_node8":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/",
          "base_url":"http://127.0.0.1:36587/solr",
          "node_name":"127.0.0.1:36587_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/tlog",
          "core":"testSimple2_shard2_replica_n7",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
Live Nodes: [127.0.0.1:36587_solr, 127.0.0.1:45575_solr]
Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/23)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/",
          "base_url":"http://127.0.0.1:34924/solr",
          "node_name":"127.0.0.1:34924_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node3/data/tlog",
          "core":"testSimple2_shard1_replica_n1",
          "shared_storage":"true",
          "state":"down"},
        "core_node4":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/",
          "base_url":"http://127.0.0.1:36587/solr",
          "node_name":"127.0.0.1:36587_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node4/data/tlog",
          "core":"testSimple2_shard1_replica_n2",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node6":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/",
          "base_url":"http://127.0.0.1:34924/solr",
          "node_name":"127.0.0.1:34924_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node6/data/tlog",
          "core":"testSimple2_shard2_replica_n5",
          "shared_storage":"true",
          "state":"down"},
        "core_node8":{
          "dataDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/",
          "base_url":"http://127.0.0.1:36587/solr",
          "node_name":"127.0.0.1:36587_solr",
          "type":"NRT",
          "force_set_state":"false",
          "ulogDir":"hdfs://localhost:39260/solr_hdfs_home/testSimple2/core_node8/data/tlog",
          "core":"testSimple2_shard2_replica_n7",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([3B1597EDEE2B1697:3A6B313C9D8C246]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:310)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:169)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)




Build Log:
[...truncated 14214 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest
   [junit4]   2> 2487453 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/init-core-data-001
   [junit4]   2> 2487453 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=289 numCloses=289
   [junit4]   2> 2487454 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2487454 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 2487567 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 2487605 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2487608 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2487668 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2487668 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2487669 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2487670 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e0c9d14{static,/static,jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.0-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 2488266 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@55e063d0{hdfs,/,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/jetty-localhost-39737-hdfs-_-any-5341189325256775315.dir/webapp/,AVAILABLE}{/hdfs}
   [junit4]   2> 2488278 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@62d3ec3a{HTTP/1.1,[http/1.1]}{localhost:39737}
   [junit4]   2> 2488278 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server Started @2488054ms
   [junit4]   2> 2488666 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2488668 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2488669 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2488669 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2488669 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2488669 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@11be4c7f{static,/static,jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.0-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 2488859 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@99b8161{datanode,/,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/jetty-localhost-32812-datanode-_-any-7662739086751743868.dir/webapp/,AVAILABLE}{/datanode}
   [junit4]   2> 2488860 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@72416a21{HTTP/1.1,[http/1.1]}{localhost:32812}
   [junit4]   2> 2488860 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server Started @2488636ms
   [junit4]   2> 2488939 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2488940 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2488941 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2488941 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2488941 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2488942 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68c75ed3{static,/static,jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-3.2.0-tests.jar!/webapps/static,AVAILABLE}
   [junit4]   2> 2489190 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x23cecc9db1754425: Processing first storage report for DS-2f2a8631-8590-4b45-99c8-3ac28413a2b1 from datanode e2eaa28e-63c3-4792-b314-38daf1f7224b
   [junit4]   2> 2489192 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x23cecc9db1754425: from storage DS-2f2a8631-8590-4b45-99c8-3ac28413a2b1 node DatanodeRegistration(127.0.0.1:42242, datanodeUuid=e2eaa28e-63c3-4792-b314-38daf1f7224b, infoPort=46493, infoSecurePort=0, ipcPort=39327, storageInfo=lv=-57;cid=testClusterID;nsid=552583631;c=1557318983730), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 2489192 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x23cecc9db1754425: Processing first storage report for DS-0053b25b-26f8-45bd-9e59-5321905ae215 from datanode e2eaa28e-63c3-4792-b314-38daf1f7224b
   [junit4]   2> 2489192 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x23cecc9db1754425: from storage DS-0053b25b-26f8-45bd-9e59-5321905ae215 node DatanodeRegistration(127.0.0.1:42242, datanodeUuid=e2eaa28e-63c3-4792-b314-38daf1f7224b, infoPort=46493, infoSecurePort=0, ipcPort=39327, storageInfo=lv=-57;cid=testClusterID;nsid=552583631;c=1557318983730), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 2489231 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@53bff2fd{datanode,/,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/jetty-localhost-36651-datanode-_-any-5449549559068011351.dir/webapp/,AVAILABLE}{/datanode}
   [junit4]   2> 2489239 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@15653fc1{HTTP/1.1,[http/1.1]}{localhost:36651}
   [junit4]   2> 2489239 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[3B1597EDEE2B1697]-worker) [    ] o.e.j.s.Server Started @2489015ms
   [junit4]   2> 2489496 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0xa865db72c04fe486: Processing first storage report for DS-0f0ff82c-44b6-409c-9c49-65b9cac833df from datanode 626e0c0b-9801-438f-b21d-074f3fa555a0
   [junit4]   2> 2489496 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0xa865db72c04fe486: from storage DS-0f0ff82c-44b6-409c-9c49-65b9cac833df node DatanodeRegistration(127.0.0.1:35568, datanodeUuid=626e0c0b-9801-438f-b21d-074f3fa555a0, infoPort=37309, infoSecurePort=0, ipcPort=46377, storageInfo=lv=-57;cid=testClusterID;nsid=552583631;c=1557318983730), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 2489496 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0xa865db72c04fe486: Processing first storage report for DS-06e50780-25f0-4c57-b3d2-2a8b35b7f65b from datanode 626e0c0b-9801-438f-b21d-074f3fa555a0
   [junit4]   2> 2489496 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0xa865db72c04fe486: from storage DS-06e50780-25f0-4c57-b3d2-2a8b35b7f65b node DatanodeRegistration(127.0.0.1:35568, datanodeUuid=626e0c0b-9801-438f-b21d-074f3fa555a0, infoPort=37309, infoSecurePort=0, ipcPort=46377, storageInfo=lv=-57;cid=testClusterID;nsid=552583631;c=1557318983730), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0
   [junit4]   2> 2489696 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 2489697 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002
   [junit4]   2> 2489698 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2489699 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2489699 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2489799 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.ZkTestServer start zk server on port:37893
   [junit4]   2> 2489799 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:37893
   [junit4]   2> 2489799 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 37893
   [junit4]   2> 2489805 INFO  (zkConnectionManagerCallback-62994-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489810 INFO  (zkConnectionManagerCallback-62996-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489812 INFO  (zkConnectionManagerCallback-62998-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489816 WARN  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2489817 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2489817 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2489817 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2489818 WARN  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2489818 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2489818 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2489818 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2489819 WARN  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2489819 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2489819 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2489819 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11.0.1+13-LTS
   [junit4]   2> 2489821 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2489821 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2489821 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2489821 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37a8f968{/solr,null,AVAILABLE}
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@12984e37{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:45575}
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.e.j.s.Server Started @2489598ms
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45575}
   [junit4]   2> 2489822 ERROR (jetty-launcher-62999-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2489822 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-05-08T12:36:26.034904Z
   [junit4]   2> 2489825 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2489825 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2489825 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2489825 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@665e43f5{/solr,null,AVAILABLE}
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1e5c3b15{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:34924}
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.e.j.s.Server Started @2489602ms
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34924}
   [junit4]   2> 2489826 ERROR (jetty-launcher-62999-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2489826 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-05-08T12:36:26.038635Z
   [junit4]   2> 2489830 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2489830 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2489830 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2489831 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2bf4d63d{/solr,null,AVAILABLE}
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6e3a1d8c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:36587}
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.e.j.s.Server Started @2489608ms
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36587}
   [junit4]   2> 2489832 ERROR (jetty-launcher-62999-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 2489832 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2489833 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2489833 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-05-08T12:36:26.045027Z
   [junit4]   2> 2489833 INFO  (zkConnectionManagerCallback-63001-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489835 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2489839 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2489839 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2489841 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2489878 INFO  (zkConnectionManagerCallback-63003-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489878 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2489882 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2489882 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2489882 INFO  (zkConnectionManagerCallback-63005-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2489883 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2489886 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2489886 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2489888 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2489889 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2490000 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2490002 WARN  (jetty-launcher-62999-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7e46b2d1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490014 WARN  (jetty-launcher-62999-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@698fecf5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490015 INFO  (jetty-launcher-62999-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37893/solr
   [junit4]   2> 2490042 INFO  (zkConnectionManagerCallback-63014-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490066 INFO  (zkConnectionManagerCallback-63016-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490114 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2490139 WARN  (jetty-launcher-62999-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@1c97c6f5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490166 WARN  (jetty-launcher-62999-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5984e121[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490167 INFO  (jetty-launcher-62999-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37893/solr
   [junit4]   2> 2490181 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45575_solr
   [junit4]   2> 2490182 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.c.Overseer Overseer (id=73266978163720199-127.0.0.1:45575_solr-n_0000000000) starting
   [junit4]   2> 2490187 INFO  (zkConnectionManagerCallback-63024-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490198 INFO  (zkConnectionManagerCallback-63029-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490203 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37893/solr ready
   [junit4]   2> 2490203 INFO  (zkConnectionManagerCallback-63031-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490206 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2490208 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:45575_solr
   [junit4]   2> 2490209 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45575_solr
   [junit4]   2> 2490210 WARN  (jetty-launcher-62999-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7ba2014a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490212 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2490214 INFO  (zkCallback-63028-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2490216 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2490222 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:34924_solr as DOWN
   [junit4]   2> 2490223 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2490223 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34924_solr
   [junit4]   2> 2490225 INFO  (zkCallback-63028-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2490225 INFO  (zkCallback-63015-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2490250 INFO  (zkCallback-63030-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2490250 WARN  (jetty-launcher-62999-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@31b2d3b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2490251 INFO  (jetty-launcher-62999-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37893/solr
   [junit4]   2> 2490259 INFO  (zkConnectionManagerCallback-63045-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490260 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2490262 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37893/solr ready
   [junit4]   2> 2490264 INFO  (zkConnectionManagerCallback-63039-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490264 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2490274 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2490300 WARN  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.m.r.j.JmxMetricsReporter Unable to register counter
   [junit4]   2>           => javax.management.InstanceNotFoundException: solr:dom1=node,category=ADMIN,scope=/admin/cores,name=totalTime
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
   [junit4]   2> javax.management.InstanceNotFoundException: solr:dom1=node,category=ADMIN,scope=/admin/cores,name=totalTime
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:531) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onCounterAdded(JmxMetricsReporter.java:596) ~[java/:?]
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.notifyListenerOfAddedMetric(MetricRegistry.java:470) ~[metrics-core-4.0.5.jar:4.0.5]
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.addListener(MetricRegistry.java:309) ~[metrics-core-4.0.5.jar:4.0.5]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:729) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:916) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:843) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:654) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:255) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:175) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:136) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:734) ~[?:?]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:734) ~[?:?]
   [junit4]   2> 	at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658) ~[?:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1449) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1513) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1158) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:995) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:467) ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:384) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) ~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) ~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:558) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:497) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:465) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:467) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:834) [?:?]
   [junit4]   2> 2490324 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490326 INFO  (zkConnectionManagerCallback-63048-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490336 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2490341 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:36587_solr as DOWN
   [junit4]   2> 2490342 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2490342 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36587_solr
   [junit4]   2> 2490370 INFO  (zkCallback-63015-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2490370 INFO  (zkCallback-63030-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2490371 INFO  (zkCallback-63028-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2490373 INFO  (zkCallback-63044-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2490382 INFO  (zkCallback-63047-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2490389 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490393 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490394 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490398 INFO  (jetty-launcher-62999-thread-2) [n:127.0.0.1:45575_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node2/.
   [junit4]   2> 2490400 INFO  (zkConnectionManagerCallback-63055-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490401 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2490403 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37893/solr ready
   [junit4]   2> 2490403 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2490493 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490493 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490504 INFO  (jetty-launcher-62999-thread-1) [n:127.0.0.1:34924_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node1/.
   [junit4]   2> 2490524 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490575 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490575 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2490577 INFO  (jetty-launcher-62999-thread-3) [n:127.0.0.1:36587_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node3/.
   [junit4]   2> 2490709 INFO  (zkConnectionManagerCallback-63061-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2490711 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2490713 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[3B1597EDEE2B1697]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37893/solr ready
   [junit4]   2> 2490731 INFO  (qtp1391586530-128346) [n:127.0.0.1:36587_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster params={wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 2490734 INFO  (qtp828536882-128335) [n:127.0.0.1:34924_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:45575_solr,127.0.0.1:34924_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2490739 INFO  (OverseerThreadFactory-14506-thread-1-processing-n:127.0.0.1:45575_solr) [n:127.0.0.1:45575_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testSimple1
   [junit4]   2> 2490849 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45575/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2490852 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34924/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2490855 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45575/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2490858 INFO  (OverseerStateUpdate-73266978163720199-127.0.0.1:45575_solr-n_0000000000) [n:127.0.0.1:45575_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34924/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2491084 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr    x:testSimple1_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2491084 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr    x:testSimple1_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2491085 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr    x:testSimple1_shard2_replica_n4] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2491086 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr    x:testSimple1_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2491086 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr    x:testSimple1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2492102 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2492102 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2492106 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2492116 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2492123 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 2492125 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 2492126 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2492126 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2492128 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2492128 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 2492128 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2492128 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 2492129 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2492129 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2492132 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39260/solr_hdfs_home
   [junit4]   2> 2492132 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39260/solr_hdfs_home
   [junit4]   2> 2492132 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2492132 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node1/testSimple1_shard1_replica_n2], dataDir=[hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node5/data/]
   [junit4]   2> 2492133 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2492133 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 2492133 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2492134 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39260/solr_hdfs_home
   [junit4]   2> 2492134 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2492134 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node1/testSimple1_shard2_replica_n6], dataDir=[hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node8/data/]
   [junit4]   2> 2492134 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2492134 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node5/data/snapshot_metadata
   [junit4]   2> 2492134 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 2492135 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14800d69
   [junit4]   2> 2492135 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39260/solr_hdfs_home
   [junit4]   2> 2492135 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2492135 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node2/testSimple1_shard2_replica_n4], dataDir=[hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node7/data/]
   [junit4]   2> 2492136 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node8/data/snapshot_metadata
   [junit4]   2> 2492136 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2492136 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_3B1597EDEE2B1697-001/tempDir-002/node2/testSimple1_shard1_replica_n1], dataDir=[hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node3/data/]
   [junit4]   2> 2492138 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node7/data/snapshot_metadata
   [junit4]   2> 2492138 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node3/data/snapshot_metadata
   [junit4]   2> 2492152 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492152 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492154 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492155 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492155 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492155 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492156 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492157 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492161 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492161 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492164 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node5/data
   [junit4]   2> 2492165 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node8/data
   [junit4]   2> 2492168 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492169 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492169 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node7/data
   [junit4]   2> 2492170 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node3/data
   [junit4]   2> 2492210 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node3/data/index
   [junit4]   2> 2492223 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492223 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492229 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node5/data/index
   [junit4]   2> 2492245 INFO  (qtp1746271433-128327) [n:127.0.0.1:45575_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492255 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492256 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492263 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node8/data/index
   [junit4]   2> 2492266 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39260/solr_hdfs_home/testSimple1/core_node7/data/index
   [junit4]   2> 2492274 INFO  (qtp828536882-128337) [n:127.0.0.1:34924_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492289 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492289 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492290 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2492290 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [33554432] will allocate [1] slabs and use ~[33554432] bytes
   [junit4]   2> 2492294 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492303 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2492617 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 2492617 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2492617 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 2492630 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2492631 INFO  (qtp1746271433-128326) [n:127.0.0.1:45575_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2492638 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 2492638 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2492638 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 2492657 INFO  (qtp828536882-128334) [n:127.0.0.1:34924_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracke

[...truncated too long message...]

erAndIndexFingerprintCachingTest, TestFacetMethods, TestIndexingPerformance, TestMergePolicyConfig, TestFiltering, TestConfigSetsAPIExclusivity, TestQueryTypes, ConfigSetsAPITest, LargeFieldTest, ConfigureRecoveryStrategyTest, IndexSizeTriggerTest, TestValueSourceCache, TestCSVLoader, TestGraphMLResponseWriter, TestOrdValues, ExternalFileFieldSortTest, TestLMJelinekMercerSimilarityFactory, TestInitParams, TestHashQParserPlugin, TestLFUCache, CdcrBidirectionalTest, TestDFRSimilarityFactory, TestSimLargeCluster, MoveReplicaHDFSTest, TestCloudJSONFacetJoinDomain, TestSha256AuthenticationProvider, TestFuzzyAnalyzedSuggestions, TestMultiWordSynonyms, CircularListTest, CollectionStateFormat2Test, DateFieldTest, WrapperMergePolicyFactoryTest, TestRandomRequestDistribution, TestRestManager, IgnoreLargeDocumentProcessorFactoryTest, TestCollectionAPIs, TestSimpleTextCodec, XmlInterpolationTest, DistributedSuggestComponentTest, SuggesterFSTTest, TestStressRecovery, TolerantUpdateProcessorTest, TestPayloadCheckQParserPlugin, TestXIncludeConfig, OverseerTaskQueueTest, TestStressInPlaceUpdates, TestSolrCloudWithKerberosAlt, CollectionTooManyReplicasTest, SearchRateTriggerIntegrationTest, AnalyticsQueryTest, CustomTermsComponentTest, TestTolerantUpdateProcessorCloud, ResourceLoaderTest, PreAnalyzedUpdateProcessorTest, DirectSolrSpellCheckerTest, TestCloudPseudoReturnFields, ReplicaListTransformerTest, ChangedSchemaMergeTest, TestHighlightDedupGrouping, TestDocSet, TestFieldCacheSort, HdfsDirectoryTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestWithCollection, LeaderFailureAfterFreshStartTest, RecoveryAfterSoftCommitTest, TestDeleteCollectionOnDownNodes, TestInPlaceUpdatesDistrib, TestRandomCollapseQParserPlugin, AliasIntegrationTest, SSLMigrationTest, TestJsonRequest, BasicDistributedZkTest, MoreLikeThisHandlerTest, SolrCLIZkUtilsTest, TriggerIntegrationTest, TestLeaderElectionWithEmptyReplica, TestDynamicFieldCollectionResource, TestTolerantSearch, ClusterStateTest, TestManagedSchema, DistributedFacetPivotLongTailTest, StatsComponentTest, SparseHLLTest, SolrCoreTest, SchemaApiFailureTest, TestAddFieldRealTimeGet, StressHdfsTest, TestSSLRandomization, TestSizeLimitedDistributedMap, TestSearcherReuse, CoreAdminHandlerTest, TestRealTimeGet, TestSolrCoreSnapshots, RemoteQueryErrorTest, TestBM25SimilarityFactory, SolrIndexMetricsTest, TestPerFieldSimilarity, TestCustomStream, TestReplicationHandlerDiskOverFlow, TestAuthenticationFramework, SolrInfoBeanTest, SplitShardTest, SpatialRPTFieldTypeTest, TestRetrieveFieldsOptimizer, ShardRoutingTest, BadCopyFieldTest, DeleteNodeTest, SolrCloudReportersTest, TestSimComputePlanAction, ReplicationFactorTest, TestHdfsBackupRestoreCore, ExecutePlanActionTest, TestPolicyCloud, MigrateRouteKeyTest, TestSolrCloudWithHadoopAuthPlugin, TokenizerChainTest, CoreMergeIndexesAdminHandlerTest, DocumentAnalysisRequestHandlerTest, TermVectorComponentDistributedTest, PreAnalyzedFieldTest, ZkNodePropsTest, TestChildDocTransformerHierarchy, DocExpirationUpdateProcessorFactoryTest, DistribJoinFromCollectionTest, DistributedQueueTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, LeaderElectionContextKeyTest, LeaderElectionIntegrationTest, LeaderElectionTest, MetricsHistoryIntegrationTest, VMParamsZkACLAndCredentialsProvidersTest, ZkCLITest, ZkControllerTest, AssignTest, CollectionsAPIDistributedZkTest, ShardSplitTest, HdfsUnloadDistributedZkTest, TestCoreDiscovery, TestDynamicURP, TestImplicitCoreProperties, TestQuerySenderListener, TestQuerySenderNoQuery, TestReloadAndDeleteDocs, TestSolrDeletionPolicy1, TestSolrDeletionPolicy2, TestSolrIndexConfig, RequestLoggingTest, ResponseBuilderTest, SearchHandlerTest, TestSQLHandler, TestSolrConfigHandlerConcurrent, TestSystemCollAutoCreate, V2ApiIntegrationTest, AutoscalingHistoryHandlerTest, PropertiesRequestHandlerTest, SecurityConfHandlerTest, SegmentsInfoRequestHandlerTest, ShowFileRequestHandlerTest, StatsReloadRaceTest, DistributedMLTComponentTest, DistributedQueryElevationComponentTest, FacetPivotSmallTest, SearchHandlerTest, RandomizedTaggerTest, Tagger2Test, TaggerTest, HighlighterMaxOffsetTest, TestPostingsSolrHighlighter, TestUnifiedSolrHighlighter, TestLegacyFieldReuse, TestLegacyTerms, TestMultiValuedNumericRangeQuery, TestNumericRangeQuery64, SolrMetricReporterTest, SolrMetricsIntegrationTest, SolrJmxReporterCloudTest, RegexBytesRefFilterTest, SimpleFacetsTest, TestRemoteStreaming, TestStreamBody, TestUnInvertedFieldException, TestWriterPerf, TestMacros, SmileWriterTest, TestCSVResponseWriter, TestPHPSerializedResponseWriter, TestSubQueryTransformerCrossCore, TestManagedResource, TestFieldCollectionResource, TestFieldResource, TestFieldTypeCollectionResource, TestFieldTypeResource, TestSchemaNameResource, TestSchemaResource, TestSchemaSimilarityResource, TestSerializedLuceneMatchVersion, TestManagedStopFilterFactory, IndexSchemaTest, NotRequiredUniqueKeyTest, NumericFieldsTest, OpenExchangeRatesOrgProviderTest, PolyFieldTest, TestManagedSchemaThreadSafety, TestPointFields, TestFieldSortValues, TestMinHashQParser, TestReload, TestReloadDeadlock, TestSolr4Spatial, TestSort, DistributedFacetSimpleRefinementLongTailTest, TestJsonFacetRefinement, TestJsonFacetsStatsParsing, TestJsonFacetsWithNestedObjects, SortByFunctionTest, TestFunctionQuery, DistanceFunctionTest, BJQParserTest, BlockJoinFacetDistribTest, BlockJoinFacetRandomTest, BlockJoinFacetSimpleTest, GraphQueryTest, TestCloudNestedDocsSort, TestNestedDocsSort, TestScoreJoinQPNoScore, TestSweetSpotSimilarityFactory, TestDefaultStatsCache, TestDistribIDF, TestLRUStatsCache, AuditLoggerPluginTest, BasicAuthIntegrationTest, JWTAuthPluginIntegrationTest]
   [junit4] Completed [762/855 (3!)] on J1 in 10.80s, 3 tests, 1 failure <<< FAILURES!

[...truncated 47499 lines...]
-ecj-javadoc-lint-src:
    [mkdir] Created dir: /tmp/ecj1605937339
 [ecj-lint] Compiling 69 source files to /tmp/ecj1605937339
 [ecj-lint] invalid Class-Path header in manifest of jar file: /x1/jenkins/.ivy2/cache/org.restlet.jee/org.restlet/jars/org.restlet-2.3.0.jar
 [ecj-lint] invalid Class-Path header in manifest of jar file: /x1/jenkins/.ivy2/cache/org.restlet.jee/org.restlet.ext.servlet/jars/org.restlet.ext.servlet-2.3.0.jar
 [ecj-lint] ----------
 [ecj-lint] 1. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 28)
 [ecj-lint] 	import javax.naming.InitialContext;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The type javax.naming.InitialContext is not accessible
 [ecj-lint] ----------
 [ecj-lint] 2. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 29)
 [ecj-lint] 	import javax.naming.NamingException;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The type javax.naming.NamingException is not accessible
 [ecj-lint] ----------
 [ecj-lint] 3. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 182)
 [ecj-lint] 	c = getFromJndi(initProps, jndiName);
 [ecj-lint] 	    ^^^^^^^^^^^
 [ecj-lint] The method getFromJndi(Properties, String) from the type new Callable<Connection>(){} refers to the missing type NamingException
 [ecj-lint] ----------
 [ecj-lint] 4. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 245)
 [ecj-lint] 	private Connection getFromJndi(final Properties initProps, final String jndiName) throws NamingException,
 [ecj-lint] 	                                                                                         ^^^^^^^^^^^^^^^
 [ecj-lint] NamingException cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 5. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 249)
 [ecj-lint] 	InitialContext ctx =  new InitialContext();
 [ecj-lint] 	^^^^^^^^^^^^^^
 [ecj-lint] InitialContext cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 6. ERROR in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java (at line 249)
 [ecj-lint] 	InitialContext ctx =  new InitialContext();
 [ecj-lint] 	                          ^^^^^^^^^^^^^^
 [ecj-lint] InitialContext cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 6 problems (6 errors)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:652: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build.xml:687: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/common-build.xml:479: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:2010: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:2049: Compile failed; see the compiler error output for details.

Total time: 387 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any