You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/25 01:07:22 UTC

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21528 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21528/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections

Error Message:
The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}

Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], BEFORE_ACTION=[compute_plan, null]}
	at __randomizedtesting.SeedInfo.seed([1EF8D84E948F36AE:24563D97AAEBEFC0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections(ComputePlanActionTest.java:469)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([1EF8D84E948F36AE:73047CB32EC7C9A9]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:313)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12274 lines...]
   [junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/init-core-data-001
   [junit4]   2> 171612 WARN  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 171612 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 171612 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 171613 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 171613 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001
   [junit4]   2> 171614 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 171628 INFO  (Thread-429) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 171628 INFO  (Thread-429) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 171639 ERROR (Thread-429) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 171728 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:41551
   [junit4]   2> 171730 INFO  (zkConnectionManagerCallback-237-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171745 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 171746 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 171780 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 171780 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 171780 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 171780 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@664cd542{/solr,null,AVAILABLE}
   [junit4]   2> 171786 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 171786 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 171786 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 171788 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72132ffa{/solr,null,AVAILABLE}
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2ec13039{SSL,[ssl, http/1.1]}{127.0.0.1:43961}
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@71847c61{SSL,[ssl, http/1.1]}{127.0.0.1:41415}
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.e.j.s.Server Started @174012ms
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.e.j.s.Server Started @174012ms
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43961}
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41415}
   [junit4]   2> 171796 ERROR (jetty-launcher-234-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 171796 ERROR (jetty-launcher-234-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T00:00:38.232558Z
   [junit4]   2> 171796 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T00:00:38.232568Z
   [junit4]   2> 171814 INFO  (zkConnectionManagerCallback-240-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171814 INFO  (zkConnectionManagerCallback-241-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171815 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 171815 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 171839 INFO  (jetty-launcher-234-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41551/solr
   [junit4]   2> 171847 INFO  (jetty-launcher-234-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41551/solr
   [junit4]   2> 171863 INFO  (zkConnectionManagerCallback-245-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171865 INFO  (zkConnectionManagerCallback-249-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171869 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10087e604270004, likely client has closed socket
   [junit4]   2> 171878 INFO  (zkConnectionManagerCallback-253-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171897 INFO  (zkConnectionManagerCallback-252-thread-1-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 171975 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 171975 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41415_solr
   [junit4]   2> 171976 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer Overseer (id=72207016019820550-127.0.0.1:41415_solr-n_0000000000) starting
   [junit4]   2> 171981 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 171982 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43961_solr
   [junit4]   2> 171999 INFO  (zkCallback-251-thread-1-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 172003 INFO  (zkCallback-250-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 172003 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 172003 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 172004 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 172004 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:43961_solr]
   [junit4]   2> 172004 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 172004 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41415_solr
   [junit4]   2> 172004 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 172007 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr"} current state version: 0
   [junit4]   2> 172007 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:41415_solr
   [junit4]   2> 172007 INFO  (zkCallback-250-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 172007 INFO  (zkCallback-251-thread-1-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 172034 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 172034 DEBUG (OverseerAutoScalingTriggerThread-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 172035 DEBUG (ScheduledTrigger-449-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 172037 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43961.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172045 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43961.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172046 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43961.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172047 INFO  (jetty-launcher-234-thread-2) [n:127.0.0.1:43961_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node2/.
   [junit4]   2> 172074 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41415.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172082 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41415.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172082 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41415.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 172084 INFO  (jetty-launcher-234-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/.
   [junit4]   2> 172128 INFO  (zkConnectionManagerCallback-259-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 172145 INFO  (zkConnectionManagerCallback-263-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 172146 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 172146 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41551/solr ready
   [junit4]   2> 172212 INFO  (qtp475191908-1356) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43961_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 172218 INFO  (OverseerThreadFactory-451-thread-1-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 172221 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":".system",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "numShards":1,
   [junit4]   2>   "createNodeSet":"127.0.0.1:43961_solr",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 172221 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 172221 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/.system/state.json
   [junit4]   2> 172325 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 172325 INFO  (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 172326 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 172326 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 172427 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 0
   [junit4]   2> 172583 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 172584 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 172608 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 172608 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 172608 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:43961/solr","node_name":"127.0.0.1:43961_solr","state":"down","type":"NRT"}
   [junit4]   2> 172608 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>           "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 172709 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 1
   [junit4]   2> 172709 INFO  (zkCallback-250-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 172711 INFO  (zkCallback-250-thread-2-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 173038 DEBUG (ScheduledTrigger-449-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 173615 WARN  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
   [junit4]   2> 173618 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 173622 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 173626 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 173630 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 173655 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 173657 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 173657 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 173658 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43961.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e7bb82
   [junit4]   2> 173670 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 173671 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
   [junit4]   2> 173771 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 173771 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 173773 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs 
   [junit4]   2> 173773 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 173775 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cdf82f6[.system_shard1_replica_n1] main]
   [junit4]   2> 173777 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 173788 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 173788 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 173789 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 173790 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 173791 INFO  (searcherExecutor-456-thread-1-processing-n:127.0.0.1:43961_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node2) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@1cdf82f6[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 173791 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593328890257866752
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:43961/solr/.system_shard1_replica_n1/
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:43961/solr/.system_shard1_replica_n1/ has no replicas
   [junit4]   2> 173799 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 173807 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:43961/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 173807 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 173908 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 2
   [junit4]   2> 173908 INFO  (zkCallback-250-thread-2-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 173908 INFO  (zkCallback-250-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 173958 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 173959 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 173959 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>   "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 173959 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:43961/solr","node_name":"127.0.0.1:43961_solr","state":"active","type":"NRT","leader":"true"}
   [junit4]   2> 173959 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/3)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:43961/solr",
   [junit4]   2>           "node_name":"127.0.0.1:43961_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true"}}}}}
   [junit4]   2> 174005 INFO  (qtp1404859822-1357) [n:127.0.0.1:43961_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1421
   [junit4]   2> 174011 INFO  (qtp475191908-1356) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 174039 DEBUG (ScheduledTrigger-449-thread-2) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 174060 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 3
   [junit4]   2> 174060 INFO  (zkCallback-250-thread-2-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174060 INFO  (zkCallback-250-thread-1-processing-n:127.0.0.1:43961_solr) [n:127.0.0.1:43961_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174219 INFO  (OverseerCollectionConfigSetProcessor-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 175013 INFO  (qtp475191908-1356) [n:127.0.0.1:41415_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43961_solr&wt=javabin&version=2} status=0 QTime=2801
   [junit4]   2> 175017 INFO  (qtp475191908-1360) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&maxShardsPerNode=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41415_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 175021 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 175022 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
   [junit4]   2> 175023 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 175025 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
   [junit4]   2> 175029 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
   [junit4]   2> 175031 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
   [junit4]   2> 175032 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 175035 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 175036 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 175037 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 175039 DEBUG (ScheduledTrigger-449-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 175042 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 175044 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 175045 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 175047 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 175048 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 175049 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 175050 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 175051 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 175068 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 175069 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 175070 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 175071 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 175072 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 175073 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 175074 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 175086 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 175087 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 175090 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 175091 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 175092 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 175093 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 175094 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 175095 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 175102 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 175143 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 175144 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 175145 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 175146 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 175147 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 175148 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 175149 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 175149 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 175150 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 175151 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 175153 INFO  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
   [junit4]   2> 175159 WARN  (OverseerThreadFactory-451-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 3 on collection AutoscalingHistoryHandlerTest_collection is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 175162 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "createNodeSet":"127.0.0.1:41415_solr",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 175162 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 175262 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 175370 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 175370 INFO  (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 175371 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 175371 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 175381 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 175381 INFO  (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 175381 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 175381 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 175397 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 175397 INFO  (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 175398 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 175398 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>       "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 175498 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
   [junit4]   2> 175618 INFO  (qtp475191908-1358) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 175619 INFO  (qtp475191908-1358) [n:127.0.0.1:41415_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 175623 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node4",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 175623 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node4",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 175623 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:41415/solr","node_name":"127.0.0.1:41415_solr","state":"down","type":"NRT"}
   [junit4]   2> 175623 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 175632 INFO  (qtp475191908-1350) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 175634 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 175634 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 175634 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:41415/solr","node_name":"127.0.0.1:41415_solr","state":"down","type":"NRT"}
   [junit4]   2> 175634 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 175640 INFO  (qtp475191908-1346) [n:127.0.0.1:41415_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n5&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 175641 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 175641 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>   "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 175641 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5","base_url":"https://127.0.0.1:41415/solr","node_name":"127.0.0.1:41415_solr","state":"down","type":"NRT"}
   [junit4]   2> 175641 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n5",
   [junit4]   2>           "base_url":"https://127.0.0.1:41415/solr",
   [junit4]   2>           "node_name":"127.0.0.1:41415_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 175742 DEBUG (OverseerStateUpdate-72207016019820550-127.0.0.1:41415_solr-n_0000000000) [n:127.0.0.1:41415_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
   [junit4]   2> 175742 INFO  (zkCallback-251-thread-1-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 175746 INFO  (zkCallback-251-thread-2-processing-n:127.0.0.1:41415_solr) [n:127.0.0.1:41415_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 176039 DEBUG (ScheduledTrigger-449-thread-1) [n:127.0.0.1:41415_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 176633 INFO  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 176633 INFO  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 176635 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
   [junit4]   2> 176635 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 176635 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
   [junit4]   2> 176636 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 176636 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
   [junit4]   2> 176636 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 176636 WARN  (qtp475191908-1358) [n:127.0.0.1:41415_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node4 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_1EF8D84E948F36AE-001/tempDir-001/node1/AutoscalingHistoryHan

[...truncated too long message...]


   [junit4]   2> 132295 INFO  (jetty-closer-195-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 132295 INFO  (coreCloseExecutor-445-thread-1) [n:127.0.0.1:40485_solr c:testSelected1 s:shard1 r:core_node5 x:testSelected1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSelected1.shard1.leader, tag=306554510
   [junit4]   2> 132295 INFO  (coreCloseExecutor-445-thread-2) [n:127.0.0.1:40485_solr c:testSelected2 s:shard1 r:core_node5 x:testSelected2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSelected2.shard1.leader, tag=1899067719
   [junit4]   2> 132295 INFO  (coreCloseExecutor-445-thread-3) [n:127.0.0.1:40485_solr c:testSelected3 s:shard2 r:core_node8 x:testSelected3_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSelected3.shard2.leader, tag=1446778424
   [junit4]   2> 132297 INFO  (jetty-closer-195-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72207270799605790-127.0.0.1:40485_solr-n_0000000007) closing
   [junit4]   2> 132297 INFO  (OverseerStateUpdate-72207270799605790-127.0.0.1:40485_solr-n_0000000007) [n:127.0.0.1:40485_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40485_solr
   [junit4]   2> 132297 WARN  (OverseerAutoScalingTriggerThread-72207270799605790-127.0.0.1:40485_solr-n_0000000007) [n:127.0.0.1:40485_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 132298 DEBUG (jetty-closer-195-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 132299 INFO  (jetty-closer-195-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@23ca5f53{/solr,null,UNAVAILABLE}
   [junit4]   2> 132299 INFO  (jetty-closer-195-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 134732 WARN  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 134732 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 134732 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.c.SolrCore [testSelected1_shard2_replica_n6]  CLOSING SolrCore org.apache.solr.core.SolrCore@4819ec65
   [junit4]   2> 134732 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSelected1.shard2.replica_n6, tag=1209658469
   [junit4]   2> 134732 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@53221f45: rootName = solr_33207, domain = solr.core.testSelected1.shard2.replica_n6, service url = null, agent id = null] for registry solr.core.testSelected1.shard2.replica_n6 / com.codahale.metrics.MetricRegistry@45a33fa9
   [junit4]   2> 134738 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:33207_solr) [n:127.0.0.1:33207_solr c:testSelected1 s:shard2 r:core_node8 x:testSelected1_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSelected1.shard2.leader, tag=1209658469
   [junit4]   2> 134739 INFO  (jetty-closer-195-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6ad26006{/solr,null,UNAVAILABLE}
   [junit4]   2> 134740 INFO  (jetty-closer-195-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 134740 ERROR (SUITE-ComputePlanActionTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 134740 INFO  (SUITE-ComputePlanActionTest-seed#[1EF8D84E948F36AE]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34767 34767
   [junit4]   2> 140268 INFO  (Thread-158) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34767 34767
   [junit4]   2> 140269 WARN  (Thread-158) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/aliases.json
   [junit4]   2> 	11	/solr/configs/conf
   [junit4]   2> 	10	/solr/security.json
   [junit4]   2> 	9	/solr/collections/testNodeWithMultipleReplicasLost/terms/shard2
   [junit4]   2> 	9	/solr/collections/testNodeWithMultipleReplicasLost/terms/shard1
   [junit4]   2> 	6	/solr/collections/testNodeLost/terms/shard1
   [junit4]   2> 	5	/solr/collections/testNodeAdded/terms/shard1
   [junit4]   2> 	5	/solr/collections/testSelected1/terms/shard2
   [junit4]   2> 	5	/solr/collections/testSelected2/terms/shard1
   [junit4]   2> 	5	/solr/collections/testSelected1/terms/shard1
   [junit4]   2> 	5	/solr/collections/testSelected2/terms/shard2
   [junit4]   2> 	5	/solr/collections/testSelected3/terms/shard2
   [junit4]   2> 	5	/solr/collections/testSelected3/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	31	/solr/collections/testSelected3/state.json
   [junit4]   2> 	27	/solr/collections/testSelected1/state.json
   [junit4]   2> 	27	/solr/collections/testSelected2/state.json
   [junit4]   2> 	19	/solr/collections/testNodeWithMultipleReplicasLost/state.json
   [junit4]   2> 	16	/solr/collections/testNodeLost/state.json
   [junit4]   2> 	15	/solr/clusterprops.json
   [junit4]   2> 	15	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/overseer_elect/election/72207270799605763-127.0.0.1:39017_solr-n_0000000000
   [junit4]   2> 	3	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/collections/testNodeAdded/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72207270799605782-127.0.0.1:34027_solr-n_0000000005
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	59	/solr/live_nodes
   [junit4]   2> 	42	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 	3	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.ComputePlanActionTest_1EF8D84E948F36AE-002
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=8, maxDocsPerChunk=10, blockSize=7), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=8, blockSize=7)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@ff433de), locale=bm-ML, timezone=Africa/Mogadishu
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=167036680,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ComputePlanActionTest, AutoscalingHistoryHandlerTest, ComputePlanActionTest]
   [junit4] Completed [9/10 (8!)] on J0 in 47.40s, 4 tests, 1 failure <<< FAILURES!

[...truncated 22 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 25 tests, 8 failures [seed: 1EF8D84E948F36AE]

Total time: 3 minutes 0 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   3/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro]   5/5 failed: org.apache.solr.cloud.autoscaling.ComputePlanActionTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=29e5b8abcee8a566cc057b862ab99c5ffef13a76, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21527
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21546 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21546/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseSerialGC

7 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:35107_solr, 127.0.0.1:36787_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/14)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node3/data/",           "base_url":"http://127.0.0.1:35107/solr",           "node_name":"127.0.0.1:35107_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node3/data/tlog",           "core":"testSimple1_shard1_replica_n1",           "shared_storage":"true",           "state":"active",           "leader":"true"},         "core_node5":{           "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/",           "base_url":"http://127.0.0.1:35107/solr",           "node_name":"127.0.0.1:35107_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/tlog",           "core":"testSimple1_shard1_replica_n2",           "shared_storage":"true",           "state":"active"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node7":{           "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node7/data/",           "base_url":"http://127.0.0.1:35107/solr",           "node_name":"127.0.0.1:35107_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node7/data/tlog",           "core":"testSimple1_shard2_replica_n4",           "shared_storage":"true",           "state":"active",           "leader":"true"},         "core_node8":{           "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/",           "base_url":"http://127.0.0.1:39747/solr",           "node_name":"127.0.0.1:39747_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/tlog",           "core":"testSimple1_shard2_replica_n6",           "shared_storage":"true",           "state":"down"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:35107_solr, 127.0.0.1:36787_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/14)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node3/data/",
          "base_url":"http://127.0.0.1:35107/solr",
          "node_name":"127.0.0.1:35107_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node3/data/tlog",
          "core":"testSimple1_shard1_replica_n1",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"},
        "core_node5":{
          "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/",
          "base_url":"http://127.0.0.1:35107/solr",
          "node_name":"127.0.0.1:35107_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/tlog",
          "core":"testSimple1_shard1_replica_n2",
          "shared_storage":"true",
          "state":"active"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node7/data/",
          "base_url":"http://127.0.0.1:35107/solr",
          "node_name":"127.0.0.1:35107_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node7/data/tlog",
          "core":"testSimple1_shard2_replica_n4",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"},
        "core_node8":{
          "dataDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/",
          "base_url":"http://127.0.0.1:39747/solr",
          "node_name":"127.0.0.1:39747_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/tlog",
          "core":"testSimple1_shard2_replica_n6",
          "shared_storage":"true",
          "state":"down"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A:416114D0F4E964EB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest:     1) Thread[id=20555, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=20694, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest: 
   1) Thread[id=20555, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=20694, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A]:0)


FAILED:  org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates

Error Message:
The ZkController.publishAndWaitForDownStates should have timed out but it didn't

Stack Trace:
java.lang.AssertionError: The ZkController.publishAndWaitForDownStates should have timed out but it didn't
	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A:5EDD5CC2728DFF05]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates(ZkControllerTest.java:306)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload

Error Message:
Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>

Stack Trace:
java.lang.AssertionError: Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>
	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A:7B6BEB42A0596CF7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload(TestJmxIntegration.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:46191/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:46191/solr/collection1
	at __randomizedtesting.SeedInfo.seed([79D2302ED31AB03A:A125F4CA78C17266]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:46191 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 47 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([41384692239A4B38:B09934C2162181AA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12700 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest
   [junit4]   2> 608397 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/init-core-data-001
   [junit4]   2> 608398 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 608398 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 608399 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001
   [junit4]   2> 608399 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 608405 INFO  (Thread-4241) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 608405 INFO  (Thread-4241) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 608421 ERROR (Thread-4241) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 608505 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:43541
   [junit4]   2> 608507 INFO  (zkConnectionManagerCallback-1372-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608510 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 608511 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 608512 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T00:27:37+03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 608533 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 608533 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 608533 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 608539 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@906599{/solr,null,AVAILABLE}
   [junit4]   2> 608542 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 608542 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 608542 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 608543 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@18ccbbc{HTTP/1.1,[http/1.1]}{127.0.0.1:36787}
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.e.j.s.Server Started @609966ms
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36787}
   [junit4]   2> 608544 ERROR (jetty-launcher-1369-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 608544 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T17:35:20.769Z
   [junit4]   2> 608545 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 608545 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 608545 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 608552 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c542da{/solr,null,AVAILABLE}
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@872ee7{HTTP/1.1,[http/1.1]}{127.0.0.1:39747}
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c16e4d{/solr,null,AVAILABLE}
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.e.j.s.Server Started @609975ms
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39747}
   [junit4]   2> 608553 ERROR (jetty-launcher-1369-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T17:35:20.778Z
   [junit4]   2> 608553 INFO  (zkConnectionManagerCallback-1374-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1f66a6e{HTTP/1.1,[http/1.1]}{127.0.0.1:35107}
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.e.j.s.Server Started @609976ms
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35107}
   [junit4]   2> 608553 ERROR (jetty-launcher-1369-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 608553 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 608554 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 608554 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T17:35:20.779Z
   [junit4]   2> 608554 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 608561 INFO  (zkConnectionManagerCallback-1376-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608562 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 608574 INFO  (jetty-launcher-1369-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43541/solr
   [junit4]   2> 608575 INFO  (zkConnectionManagerCallback-1378-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608576 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 608583 INFO  (zkConnectionManagerCallback-1382-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608586 INFO  (jetty-launcher-1369-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43541/solr
   [junit4]   2> 608593 INFO  (zkConnectionManagerCallback-1386-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608599 INFO  (jetty-launcher-1369-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43541/solr
   [junit4]   2> 608600 INFO  (zkConnectionManagerCallback-1388-thread-1-processing-n:127.0.0.1:36787_solr) [n:127.0.0.1:36787_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608617 INFO  (zkConnectionManagerCallback-1394-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608626 INFO  (zkConnectionManagerCallback-1392-thread-1-processing-n:127.0.0.1:39747_solr) [n:127.0.0.1:39747_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608631 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 608632 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39747_solr
   [junit4]   2> 608632 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.Overseer Overseer (id=72222487927259143-127.0.0.1:39747_solr-n_0000000000) starting
   [junit4]   2> 608637 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 608637 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36787_solr
   [junit4]   2> 608637 INFO  (zkConnectionManagerCallback-1397-thread-1-processing-n:127.0.0.1:35107_solr) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608641 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 608642 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 608645 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35107_solr
   [junit4]   2> 608662 INFO  (zkCallback-1390-thread-1-processing-n:127.0.0.1:39747_solr) [n:127.0.0.1:39747_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 608670 INFO  (zkCallback-1387-thread-1-processing-n:127.0.0.1:36787_solr) [n:127.0.0.1:36787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 608681 INFO  (zkCallback-1390-thread-2-processing-n:127.0.0.1:39747_solr) [n:127.0.0.1:39747_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 608708 INFO  (zkCallback-1396-thread-1-processing-n:127.0.0.1:35107_solr) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 608718 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 608718 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39747_solr
   [junit4]   2> 608718 INFO  (zkCallback-1387-thread-1-processing-n:127.0.0.1:36787_solr) [n:127.0.0.1:36787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 608719 INFO  (zkCallback-1396-thread-1-processing-n:127.0.0.1:35107_solr) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 608719 INFO  (zkCallback-1390-thread-2-processing-n:127.0.0.1:39747_solr) [n:127.0.0.1:39747_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 608719 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 608727 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36787_solr, 127.0.0.1:35107_solr, 127.0.0.1:39747_solr]
   [junit4]   2> 608728 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 608728 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 608745 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 608746 DEBUG (OverseerAutoScalingTriggerThread-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 608746 DEBUG (ScheduledTrigger-2470-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 608771 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36787.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608779 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36787.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608780 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36787.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608781 INFO  (jetty-launcher-1369-thread-2) [n:127.0.0.1:36787_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001/node2/.
   [junit4]   2> 608790 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35107.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608792 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39747.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608797 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35107.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608797 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35107.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608798 INFO  (jetty-launcher-1369-thread-3) [n:127.0.0.1:35107_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001/node3/.
   [junit4]   2> 608800 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39747.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608800 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39747.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 608801 INFO  (jetty-launcher-1369-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001/node1/.
   [junit4]   2> 608905 INFO  (zkConnectionManagerCallback-1404-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608937 INFO  (zkConnectionManagerCallback-1408-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 608938 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 608938 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43541/solr ready
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 609040 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 609049 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 609051 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 609066 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_38887_hdfs____la5oy4/webapp
   [junit4]   2> 609566 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38887
   [junit4]   2> 609658 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 609659 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 609670 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42327_datanode____kczuqp/webapp
   [junit4]   2> 609747 DEBUG (ScheduledTrigger-2470-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 610130 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42327
   [junit4]   2> 610253 WARN  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 610254 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 610278 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42027_datanode____glfpge/webapp
   [junit4]   2> 610369 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:36449) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 610383 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x8f05d3c1f693f: from storage DS-70df5f6e-84c0-48c3-bb6b-09cd8aa71914 node DatanodeRegistration(127.0.0.1:33161, datanodeUuid=9aceb1de-30ec-4ee4-8c36-99cd96e605c4, infoPort=38513, infoSecurePort=0, ipcPort=41943, storageInfo=lv=-56;cid=testClusterID;nsid=803200400;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 610383 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x8f05d3c1f693f: from storage DS-a920c5e4-ffc6-430a-8012-8df0c4574ee2 node DatanodeRegistration(127.0.0.1:33161, datanodeUuid=9aceb1de-30ec-4ee4-8c36-99cd96e605c4, infoPort=38513, infoSecurePort=0, ipcPort=41943, storageInfo=lv=-56;cid=testClusterID;nsid=803200400;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 610748 DEBUG (ScheduledTrigger-2470-thread-2) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 610781 INFO  (SUITE-HdfsAutoAddReplicasIntegrationTest-seed#[79D2302ED31AB03A]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42027
   [junit4]   2> 610879 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:36449) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 610882 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x8f05d59e7d9ab: from storage DS-03023de3-63ca-4a8c-8547-09744c54f4b1 node DatanodeRegistration(127.0.0.1:46051, datanodeUuid=f07ce6bc-673b-4405-be52-7bb58a5460be, infoPort=43367, infoSecurePort=0, ipcPort=45831, storageInfo=lv=-56;cid=testClusterID;nsid=803200400;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 610882 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x8f05d59e7d9ab: from storage DS-025e54bd-d78e-4291-9ce5-c048e9e1b576 node DatanodeRegistration(127.0.0.1:46051, datanodeUuid=f07ce6bc-673b-4405-be52-7bb58a5460be, infoPort=43367, infoSecurePort=0, ipcPort=45831, storageInfo=lv=-56;cid=testClusterID;nsid=803200400;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 610983 INFO  (TEST-HdfsAutoAddReplicasIntegrationTest.testSimple-seed#[79D2302ED31AB03A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 610984 INFO  (qtp2802119-9079) [n:127.0.0.1:36787_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:36787_solr,127.0.0.1:35107_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 610988 INFO  (OverseerThreadFactory-2472-thread-1-processing-n:127.0.0.1:39747_solr) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testSimple1
   [junit4]   2> 611092 INFO  (OverseerStateUpdate-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35107/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 611092 INFO  (OverseerStateUpdate-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36787/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 611093 INFO  (OverseerStateUpdate-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35107/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 611094 INFO  (OverseerStateUpdate-72222487927259143-127.0.0.1:39747_solr-n_0000000000) [n:127.0.0.1:39747_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36787/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 611296 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 611297 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 611297 INFO  (qtp29887857-9087) [n:127.0.0.1:35107_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 611298 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 611298 INFO  (qtp29887857-9087) [n:127.0.0.1:35107_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 611302 INFO  (qtp29887857-9090) [n:127.0.0.1:35107_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 611410 INFO  (zkCallback-1387-thread-1-processing-n:127.0.0.1:36787_solr) [n:127.0.0.1:36787_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 611410 INFO  (zkCallback-1396-thread-1-processing-n:127.0.0.1:35107_solr) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 611410 INFO  (zkCallback-1396-thread-2-processing-n:127.0.0.1:35107_solr) [n:127.0.0.1:35107_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 611748 DEBUG (ScheduledTrigger-2470-thread-1) [n:127.0.0.1:39747_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 612305 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 612306 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 612603 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 612603 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 612606 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 612606 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 612606 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 612606 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
   [junit4]   2> 612607 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36787.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 612607 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36787.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@14e20a0
   [junit4]   2> 612607 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:36449/data
   [junit4]   2> 612607 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:36449/data
   [junit4]   2> 612607 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 612607 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 612607 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 612607 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 612607 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001/node2/testSimple1_shard1_replica_n2], dataDir=[hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/]
   [junit4]   2> 612607 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest_79D2302ED31AB03A-001/tempDir-001/node2/testSimple1_shard2_replica_n6], dataDir=[hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/]
   [junit4]   2> 612607 INFO  (qtp29887857-9087) [n:127.0.0.1:35107_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 612608 INFO  (qtp2802119-9084) [n:127.0.0.1:36787_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:36449/data/testSimple1/core_node5/data/snapshot_metadata
   [junit4]   2> 612608 INFO  (qtp2802119-9092) [n:127.0.0.1:36787_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:36449/data/testSimple1/core_node8/data/snapshot_metadata
   [junit4]   2> 612611 INFO  (qtp29887857-9090) [n:127.0.0.1:35107_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 612621 INFO  (qtp29887857-9087) [n:127.0.0.1:35107_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4

[...truncated too long message...]

RReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.05s J0 | TestLTRReRankingPipeline.testRescorer
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=FST50, id=FSTOrd50, final-score=FSTOrd50}, docValues:{final-score=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=282, maxMBSortInHeap=6.47197799714947, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@18d5bf9), locale=ca, timezone=Jamaica
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=54218624,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline]
   [junit4] Completed [2/5 (2!)] on J0 in 1.34s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4]   2> 0    INFO  (SUITE-TestLTRReRankingPipeline-seed#[41384692239A4B38]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4] OK      0.11s J1 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 940  INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 942  INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=41384692239A4B38 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=Jamaica -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.44s J1 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41384692239A4B38:B09934C2162181AA]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.06s J1 | TestLTRReRankingPipeline.testRescorer
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=FST50, id=FSTOrd50, final-score=FSTOrd50}, docValues:{final-score=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=282, maxMBSortInHeap=6.47197799714947, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@18d5bf9), locale=ca, timezone=Jamaica
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=54546848,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline]
   [junit4] Completed [3/5 (3!)] on J1 in 1.31s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.ltr.TestLTRReRankingPipeline. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4] OK      0.02s J2 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 1288 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 1289 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=41384692239A4B38 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=Jamaica -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.02s J2 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41384692239A4B38:B09934C2162181AA]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.01s J2 | TestLTRReRankingPipeline.testRescorer
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=FST50, id=FSTOrd50, final-score=FSTOrd50}, docValues:{final-score=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=282, maxMBSortInHeap=6.47197799714947, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@16fca60), locale=ca, timezone=Jamaica
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=53707208,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline, TestLTRReRankingPipeline]
   [junit4] Completed [4/5 (4!)] on J2 in 0.07s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4] OK      0.01s J1 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 1333 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 1334 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[41384692239A4B38]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=41384692239A4B38 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=Jamaica -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.02s J1 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41384692239A4B38:B09934C2162181AA]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] OK      0.03s J1 | TestLTRReRankingPipeline.testRescorer
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=FST50, id=FSTOrd50, final-score=FSTOrd50}, docValues:{final-score=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=282, maxMBSortInHeap=6.47197799714947, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@16fca60), locale=ca, timezone=Jamaica
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=53750008,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline, TestLTRReRankingPipeline]
   [junit4] Completed [5/5 (5!)] on J1 in 0.08s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 41384692239A4B38]:
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.35 ..     2.23 =     1.87s
   [junit4] JVM J1:     0.35 ..     2.73 =     2.38s
   [junit4] JVM J2:     0.35 ..     2.71 =     2.36s
   [junit4] Execution time total: 2.74 sec.
   [junit4] Tests summary: 5 suites, 15 tests, 5 failures

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 15 tests, 5 failures [seed: 41384692239A4B38]

Total time: 3 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest
[repro]   5/5 failed: org.apache.solr.cloud.SSLMigrationTest
[repro]   5/5 failed: org.apache.solr.cloud.ZkControllerTest
[repro]   5/5 failed: org.apache.solr.core.TestJmxIntegration
[repro]   5/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d512cd7604741a2f55deb0c840188f0342f1ba57, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21545
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21545 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21545/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseG1GC

8 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
expected:<COMPLETED> but was:<RUNNING>

Stack Trace:
java.lang.AssertionError: expected:<COMPLETED> but was:<RUNNING>
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0:FCB5625344194D58]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:289)
	at org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:142)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0:58D32A0466215624]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:904)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:5j4hs8tkzq2ku6f2gk2a+jijtmzwogqv2hbr4svum+6v54kdzlv7ph1j2lqde6+dl5ei79o2glagimrzkui+kh20d610ivc3dek8cv6b&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:897)
	... 40 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest:     1) Thread[id=25093, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=25229, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest: 
   1) Thread[id=25093, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=25229, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0]:0)


FAILED:  org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates

Error Message:
The ZkController.publishAndWaitForDownStates should have timed out but it didn't

Stack Trace:
java.lang.AssertionError: The ZkController.publishAndWaitForDownStates should have timed out but it didn't
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0:53EE31654B726F9F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates(ZkControllerTest.java:306)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload

Error Message:
Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>

Stack Trace:
java.lang.AssertionError: Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0:765886E599A6FC6D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload(TestJmxIntegration.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:40773/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:40773/solr/collection1
	at __randomizedtesting.SeedInfo.seed([74E15D89EAE520A0:AC16996D413EE2FC]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40773 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 47 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([3E1B0561EE27015D:CFBA7731DB9CCBCF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12184 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> 157543 INFO  (SUITE-TestReplicationHandler-seed#[74E15D89EAE520A0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/init-core-data-001
   [junit4]   2> 157543 WARN  (SUITE-TestReplicationHandler-seed#[74E15D89EAE520A0]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 157544 INFO  (SUITE-TestReplicationHandler-seed#[74E15D89EAE520A0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 157545 INFO  (SUITE-TestReplicationHandler-seed#[74E15D89EAE520A0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 157546 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestRepeater
   [junit4]   2> 157546 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/collection1
   [junit4]   2> 157549 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 157549 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 157549 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 157549 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 157550 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@742ead{/solr,null,AVAILABLE}
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@962f69{HTTP/1.1,[http/1.1]}{127.0.0.1:34257}
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server Started @158665ms
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=34257}
   [junit4]   2> 157552 ERROR (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 157552 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T13:03:17.539Z
   [junit4]   2> 157553 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/solr.xml
   [junit4]   2> 157556 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 157556 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 157557 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 157590 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157600 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157600 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157602 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/.
   [junit4]   2> 157602 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 157603 INFO  (coreLoadExecutor-788-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 157612 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 157618 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 157620 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 157620 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/./collection1, trusted=true
   [junit4]   2> 157620 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157620 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 157620 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 157622 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=23.2109375, floorSegmentMB=1.9013671875, forceMergeDeletesPctAllowed=24.16452583793328, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26748629349743364
   [junit4]   2> 157659 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 157659 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 157660 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=62.341796875, floorSegmentMB=1.1728515625, forceMergeDeletesPctAllowed=12.355378958431476, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4175273816277474
   [junit4]   2> 157660 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a699f7[collection1] main]
   [junit4]   2> 157661 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-001/collection1/conf
   [junit4]   2> 157661 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 157661 INFO  (coreLoadExecutor-788-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 157663 INFO  (searcherExecutor-789-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1a699f7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 157663 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1
   [junit4]   2> 157665 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 157666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 157666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 157666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 157666 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a4101d{/solr,null,AVAILABLE}
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1619901{HTTP/1.1,[http/1.1]}{127.0.0.1:33613}
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server Started @158780ms
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=33613}
   [junit4]   2> 157667 ERROR (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T13:03:17.654Z
   [junit4]   2> 157667 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/solr.xml
   [junit4]   2> 157670 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 157670 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 157671 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 157704 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157715 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157715 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157717 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/.
   [junit4]   2> 157717 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 157718 INFO  (coreLoadExecutor-798-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 157727 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 157743 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 157744 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 157744 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/./collection1, trusted=true
   [junit4]   2> 157745 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157745 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 157745 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 157747 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=23.2109375, floorSegmentMB=1.9013671875, forceMergeDeletesPctAllowed=24.16452583793328, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26748629349743364
   [junit4]   2> 157786 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 157786 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 157787 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=62.341796875, floorSegmentMB=1.1728515625, forceMergeDeletesPctAllowed=12.355378958431476, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4175273816277474
   [junit4]   2> 157788 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e2bd55[collection1] main]
   [junit4]   2> 157788 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1/conf
   [junit4]   2> 157790 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 157790 INFO  (coreLoadExecutor-798-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 157793 INFO  (searcherExecutor-799-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1e2bd55[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 157794 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1619901{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 157794 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=23001104
   [junit4]   2> 157794 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 157794 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@239bea: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@193eac7
   [junit4]   2> 157794 INFO  (qtp15928945-1746) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 157795 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 157795 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 157795 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 157795 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 157795 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 157796 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 157796 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@d0032d commitCommandVersion:0
   [junit4]   2> 157797 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@afaeb9[collection1] main]
   [junit4]   2> 157797 INFO  (indexFetcher-803-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 157800 INFO  (searcherExecutor-799-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@afaeb9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 157802 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 157802 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@be060f: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1e2496b
   [junit4]   2> 157808 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 157808 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17de389: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@19b28e2
   [junit4]   2> 157809 INFO  (coreCloseExecutor-804-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@fc85fd
   [junit4]   2> 157809 INFO  (coreCloseExecutor-804-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=16549373
   [junit4]   2> 157809 INFO  (coreCloseExecutor-804-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@444d66: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5e2dd4
   [junit4]   2> 157819 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a4101d{/solr,null,UNAVAILABLE}
   [junit4]   2> 157819 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 157857 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 157857 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 157857 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 157857 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 157858 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ec197a{/solr,null,AVAILABLE}
   [junit4]   2> 157858 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@641b46{HTTP/1.1,[http/1.1]}{127.0.0.1:39385}
   [junit4]   2> 157858 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server Started @158971ms
   [junit4]   2> 157858 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=39385}
   [junit4]   2> 157858 ERROR (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 157859 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 157859 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 157859 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 157859 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T13:03:17.846Z
   [junit4]   2> 157859 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/solr.xml
   [junit4]   2> 157862 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 157862 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 157863 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 157896 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157906 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157906 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157908 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/.
   [junit4]   2> 157908 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 157909 INFO  (coreLoadExecutor-811-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 157918 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 157923 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 157925 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 157925 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/./collection1, trusted=true
   [junit4]   2> 157925 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18ec7f4
   [junit4]   2> 157925 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 157926 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 157927 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=23.2109375, floorSegmentMB=1.9013671875, forceMergeDeletesPctAllowed=24.16452583793328, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26748629349743364
   [junit4]   2> 157965 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 157965 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 157966 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=62.341796875, floorSegmentMB=1.1728515625, forceMergeDeletesPctAllowed=12.355378958431476, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4175273816277474
   [junit4]   2> 157967 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@126a053[collection1] main]
   [junit4]   2> 157967 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-002/collection1/conf
   [junit4]   2> 157967 INFO  (coreLoadExecutor-811-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 157969 INFO  (searcherExecutor-812-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@126a053[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 157970 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-003/collection1
   [junit4]   2> 157972 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 157973 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 157973 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 157973 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 157973 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c18c7f{/solr,null,AVAILABLE}
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1180562{HTTP/1.1,[http/1.1]}{127.0.0.1:44543}
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.e.j.s.Server Started @159087ms
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_74E15D89EAE520A0-001/solr-instance-003/collection1/data, hostContext=/solr, hostPort=44543}
   [junit4]   2> 157974 ERROR (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T13:03:17.961Z
   [junit4]   2> 157974 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[74E15D89EAE520A0]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHan

[...truncated too long message...]

ankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=3E1B0561EE27015D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=America/Pangnirtung -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.05s J2 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3E1B0561EE27015D:CFBA7731DB9CCBCF]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@624d8), locale=nl-NL, timezone=America/Pangnirtung
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=37606912,total=78643200
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline]
   [junit4] Completed [2/5 (2!)] on J2 in 1.15s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: org.apache.solr.ltr.TestLTRReRankingPipeline. This may confuse tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4] OK      0.02s J0 | TestLTRReRankingPipeline.testRescorer
   [junit4] OK      0.00s J0 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 1208 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 1209 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=3E1B0561EE27015D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=America/Pangnirtung -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.01s J0 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3E1B0561EE27015D:CFBA7731DB9CCBCF]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@c5d339), locale=nl-NL, timezone=America/Pangnirtung
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=40531704,total=71303168
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline, TestLTRReRankingPipeline]
   [junit4] Completed [3/5 (3!)] on J0 in 0.05s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4] OK      0.02s J2 | TestLTRReRankingPipeline.testRescorer
   [junit4] OK      0.00s J2 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 1207 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 1207 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=3E1B0561EE27015D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=America/Pangnirtung -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.01s J2 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3E1B0561EE27015D:CFBA7731DB9CCBCF]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@126acf4), locale=nl-NL, timezone=America/Pangnirtung
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=54644184,total=78643200
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline, TestLTRReRankingPipeline]
   [junit4] Completed [4/5 (4!)] on J2 in 0.05s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] Started J1 PID(22658@serv1.sd-datasolutions.de).
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4]   2> 0    INFO  (SUITE-TestLTRReRankingPipeline-seed#[3E1B0561EE27015D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4] OK      0.50s J1 | TestLTRReRankingPipeline.testRescorer
   [junit4] OK      0.01s J1 | TestLTRReRankingPipeline.testDocParam
   [junit4]   2> 790  INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 791  INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[3E1B0561EE27015D]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=3E1B0561EE27015D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl-NL -Dtests.timezone=America/Pangnirtung -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.05s J1 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3E1B0561EE27015D:CFBA7731DB9CCBCF]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4452b3), locale=nl-NL, timezone=America/Pangnirtung
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=24568168,total=49283072
   [junit4]   2> NOTE: All tests run in this JVM: [TestLTRReRankingPipeline]
   [junit4] Completed [5/5 (5!)] on J1 in 1.04s, 3 tests, 1 failure <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 3E1B0561EE27015D]:
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4]   - org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.63 ..     2.74 =     2.11s
   [junit4] JVM J1:    15.38 ..    15.64 =     0.26s
   [junit4] JVM J2:     0.63 ..     2.75 =     2.12s
   [junit4] Execution time total: 15 seconds
   [junit4] Tests summary: 5 suites, 15 tests, 5 failures

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 15 tests, 5 failures [seed: 3E1B0561EE27015D]

Total time: 16 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore
[repro]   5/5 failed: org.apache.solr.cloud.SSLMigrationTest
[repro]   5/5 failed: org.apache.solr.cloud.ZkControllerTest
[repro]   5/5 failed: org.apache.solr.core.TestJmxIntegration
[repro]   5/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro]   5/5 failed: org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d512cd7604741a2f55deb0c840188f0342f1ba57, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21544
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21544 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21544/
Java: 64bit/jdk1.8.0_162 -XX:+UseCompressedOops -XX:+UseParallelGC

6 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


	at __randomizedtesting.SeedInfo.seed([8EF5B43ED017BC9]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest:     1) Thread[id=4395, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4534, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest: 
   1) Thread[id=4395, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4534, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([8EF5B43ED017BC9]:0)


FAILED:  org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates

Error Message:
The ZkController.publishAndWaitForDownStates should have timed out but it didn't

Stack Trace:
java.lang.AssertionError: The ZkController.publishAndWaitForDownStates should have timed out but it didn't
	at __randomizedtesting.SeedInfo.seed([8EF5B43ED017BC9:2FE037AF4C9634F6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates(ZkControllerTest.java:306)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload

Error Message:
Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>

Stack Trace:
java.lang.AssertionError: Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>
	at __randomizedtesting.SeedInfo.seed([8EF5B43ED017BC9:A56802F9E42A704]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload(TestJmxIntegration.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:36399/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:36399/solr/collection1
	at __randomizedtesting.SeedInfo.seed([8EF5B43ED017BC9:D0189FA746DAB995]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36399 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 47 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([A78D69AC4FA48F75:562C1BFC7A1F45E7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12390 lines...]
   [junit4] Suite: org.apache.solr.cloud.SSLMigrationTest
   [junit4]   2> 484796 INFO  (SUITE-SSLMigrationTest-seed#[8EF5B43ED017BC9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/init-core-data-001
   [junit4]   2> 484797 WARN  (SUITE-SSLMigrationTest-seed#[8EF5B43ED017BC9]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 484797 INFO  (SUITE-SSLMigrationTest-seed#[8EF5B43ED017BC9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 484798 INFO  (SUITE-SSLMigrationTest-seed#[8EF5B43ED017BC9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 484798 INFO  (SUITE-SSLMigrationTest-seed#[8EF5B43ED017BC9]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 484799 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 484799 INFO  (Thread-1193) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 484799 INFO  (Thread-1193) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 484801 ERROR (Thread-1193) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 484899 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.ZkTestServer start zk server on port:42253
   [junit4]   2> 484902 INFO  (zkConnectionManagerCallback-820-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484906 INFO  (zkConnectionManagerCallback-822-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484909 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 484909 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 484910 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 484910 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 484911 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 484911 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 484912 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 484912 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 484913 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 484913 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 484913 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 484914 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 484983 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 484983 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 484983 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 484983 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 484984 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4599927c{/,null,AVAILABLE}
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@45d4cb22{HTTP/1.1,[http/1.1]}{127.0.0.1:45603}
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server Started @486428ms
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/tempDir-001/control/data, hostContext=/, hostPort=45603, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/control-001/cores}
   [junit4]   2> 484985 ERROR (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 484985 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 484986 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T09:00:09.109Z
   [junit4]   2> 484987 INFO  (zkConnectionManagerCallback-824-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484988 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 484988 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/control-001/solr.xml
   [junit4]   2> 484990 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 484990 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 484991 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 484993 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42253/solr
   [junit4]   2> 484994 INFO  (zkConnectionManagerCallback-828-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484996 INFO  (zkConnectionManagerCallback-830-thread-1-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485023 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 485023 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45603_
   [junit4]   2> 485024 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.c.Overseer Overseer (id=72220462097104900-127.0.0.1:45603_-n_0000000000) starting
   [junit4]   2> 485026 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45603_
   [junit4]   2> 485027 INFO  (zkCallback-829-thread-1-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 485057 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 485062 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 485062 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 485063 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:45603_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/control-001/cores
   [junit4]   2> 485075 INFO  (zkConnectionManagerCallback-836-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485076 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 485077 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42253/solr ready
   [junit4]   2> 485078 INFO  (qtp922237656-4209) [n:127.0.0.1:45603_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45603_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 485079 INFO  (OverseerThreadFactory-1637-thread-1-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 485183 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 485184 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 485286 INFO  (zkCallback-829-thread-1-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 486301 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 486309 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 486369 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 486376 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 486376 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 486376 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 486376 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 486378 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=23.2548828125, floorSegmentMB=1.5244140625, forceMergeDeletesPctAllowed=5.083739320542796, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 486380 WARN  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 486408 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 486408 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 486409 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 486409 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 486410 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=16.5048828125, floorSegmentMB=2.1591796875, forceMergeDeletesPctAllowed=25.15407831438425, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 486410 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@32fb6a88[control_collection_shard1_replica_n1] main]
   [junit4]   2> 486410 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 486411 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 486411 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 486412 INFO  (searcherExecutor-1640-thread-1-processing-n:127.0.0.1:45603_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@32fb6a88[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 486412 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593544026918748160
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45603/control_collection_shard1_replica_n1/
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45603/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 486416 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 486417 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45603/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 486519 INFO  (zkCallback-829-thread-2-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 486568 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 486570 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1386
   [junit4]   2> 486572 INFO  (qtp922237656-4209) [n:127.0.0.1:45603_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 486670 INFO  (zkCallback-829-thread-2-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 487080 INFO  (OverseerCollectionConfigSetProcessor-72220462097104900-127.0.0.1:45603_-n_0000000000) [n:127.0.0.1:45603_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 487572 INFO  (qtp922237656-4209) [n:127.0.0.1:45603_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45603_&wt=javabin&version=2} status=0 QTime=2494
   [junit4]   2> 487575 INFO  (zkConnectionManagerCallback-840-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487576 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 487578 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42253/solr ready
   [junit4]   2> 487578 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 487579 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 487579 INFO  (OverseerThreadFactory-1637-thread-2-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 487580 WARN  (OverseerThreadFactory-1637-thread-2-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 487783 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 487784 INFO  (qtp922237656-4215) [n:127.0.0.1:45603_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=205
   [junit4]   2> 487842 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001 of type NRT
   [junit4]   2> 487843 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c276459{/,null,AVAILABLE}
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@400146f{HTTP/1.1,[http/1.1]}{127.0.0.1:36697}
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server Started @489288ms
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=36697, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001/cores}
   [junit4]   2> 487844 ERROR (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 487844 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 487845 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T09:00:11.968Z
   [junit4]   2> 487846 INFO  (zkConnectionManagerCallback-842-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487846 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 487846 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001/solr.xml
   [junit4]   2> 487848 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 487848 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 487849 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 487850 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42253/solr
   [junit4]   2> 487852 INFO  (zkConnectionManagerCallback-846-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487853 INFO  (zkConnectionManagerCallback-848-thread-1-processing-n:127.0.0.1:36697_) [n:127.0.0.1:36697_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487856 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 487856 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 487857 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36697_
   [junit4]   2> 487857 INFO  (zkCallback-829-thread-2-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 487858 INFO  (zkCallback-839-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 487858 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:36697_) [n:127.0.0.1:36697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 487882 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 487887 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 487887 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 487888 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [n:127.0.0.1:36697_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001/cores
   [junit4]   2> 487905 INFO  (qtp1748759232-4260) [n:127.0.0.1:36697_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36697_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 487907 INFO  (OverseerCollectionConfigSetProcessor-72220462097104900-127.0.0.1:45603_-n_0000000000) [n:127.0.0.1:45603_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 487907 INFO  (OverseerThreadFactory-1637-thread-3-processing-n:127.0.0.1:45603_) [n:127.0.0.1:45603_    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:36697_ for creating new replica
   [junit4]   2> 487911 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 487912 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 488014 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:36697_) [n:127.0.0.1:36697_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 488921 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 488928 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 488997 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 489005 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 489005 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1765f78
   [junit4]   2> 489005 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 489005 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 489007 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=23.2548828125, floorSegmentMB=1.5244140625, forceMergeDeletesPctAllowed=5.083739320542796, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 489008 WARN  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 489031 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 489031 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 489032 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 489032 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 489032 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=16.5048828125, floorSegmentMB=2.1591796875, forceMergeDeletesPctAllowed=25.15407831438425, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 489033 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@761382[collection1_shard2_replica_n41] main]
   [junit4]   2> 489033 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 489034 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 489034 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 489034 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593544029668114432
   [junit4]   2> 489035 INFO  (searcherExecutor-1651-thread-1-processing-n:127.0.0.1:36697_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@761382[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36697/collection1_shard2_replica_n41/
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:36697/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 489038 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 489039 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36697/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 489140 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:36697_) [n:127.0.0.1:36697_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 489189 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 489191 INFO  (qtp1748759232-4266) [n:127.0.0.1:36697_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1280
   [junit4]   2> 489193 INFO  (qtp1748759232-4260) [n:127.0.0.1:36697_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36697_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1288
   [junit4]   2> 489253 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-2-001 of type NRT
   [junit4]   2> 489253 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 489254 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 489254 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 489254 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 489254 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@319dae4f{/,null,AVAILABLE}
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4df684fd{HTTP/1.1,[http/1.1]}{127.0.0.1:38207}
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.Server Started @490698ms
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=38207, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-2-001/cores}
   [junit4]   2> 489255 ERROR (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 489255 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T09:00:13.378Z
   [junit4]   2> 489257 INFO  (zkConnectionManagerCallback-852-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 489257 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 489257 INFO  (TEST-SSLMigrationTest.test-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_8EF5B43ED017BC9-001/shard-2-001/solr.xml
 

[...truncated too long message...]

rJmxReporter@685c7639: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@65d29529
   [junit4]   2> 365868 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 365868 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d39bab: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3909152a
   [junit4]   2> 365870 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 365870 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66a48da1: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3598e8ee
   [junit4]   2> 365870 INFO  (coreCloseExecutor-1137-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@53af1168
   [junit4]   2> 365870 INFO  (coreCloseExecutor-1137-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1403982184
   [junit4]   2> 365870 INFO  (coreCloseExecutor-1137-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@607cc51a: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@63a62a71
   [junit4]   2> 365947 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@728805d7{/solr,null,UNAVAILABLE}
   [junit4]   2> 365947 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 365948 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7ebba81d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 365948 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=953285072
   [junit4]   2> 365948 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 365948 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@361e9555: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2c46fd6
   [junit4]   2> 365952 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 365952 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c5811c1: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3909152a
   [junit4]   2> 365955 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 365955 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@86e75a9: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3598e8ee
   [junit4]   2> 365955 INFO  (coreCloseExecutor-1139-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@10312d75
   [junit4]   2> 365955 INFO  (coreCloseExecutor-1139-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=271658357
   [junit4]   2> 365955 INFO  (coreCloseExecutor-1139-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@116d084e: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5d7e4ddd
   [junit4]   2> 365962 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@253c20e1{/solr,null,UNAVAILABLE}
   [junit4]   2> 365962 INFO  (TEST-TestReplicationHandler.testRateLimitedReplication-seed#[8EF5B43ED017BC9]) [    ] o.e.j.s.session Stopped scavenging
   [junit4] OK      8.96s J1 | TestReplicationHandler.testRateLimitedReplication
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_8EF5B43ED017BC9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {name=PostingsFormat(name=Memory), id=PostingsFormat(name=Memory), newname=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=69, maxMBSortInHeap=6.202357017850442, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3f42560c), locale=lv-LV, timezone=Africa/Ndjamena
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=209640328,total=472383488
   [junit4]   2> NOTE: All tests run in this JVM: [ZkControllerTest, SSLMigrationTest, TestJmxIntegration, SSLMigrationTest, TestReplicationHandler]
   [junit4] Completed [20/20 (20!)] on J1 in 56.34s, 16 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 8EF5B43ED017BC9] (first 10 out of 20):
   [junit4]   - org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload
   [junit4]   - org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates
   [junit4]   - org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates
   [junit4]   - org.apache.solr.cloud.SSLMigrationTest (suite)
   [junit4]   - org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates
   [junit4]   - org.apache.solr.cloud.SSLMigrationTest (suite)
   [junit4]   - org.apache.solr.cloud.SSLMigrationTest (suite)
   [junit4]   - org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload
   [junit4]   - org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates
   [junit4]   - org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.38 ..   357.66 =   357.28s
   [junit4] JVM J1:     0.38 ..   368.19 =   367.81s
   [junit4] JVM J2:     0.38 ..   328.79 =   328.41s
   [junit4] Execution time total: 6 minutes 8 seconds
   [junit4] Tests summary: 20 suites, 120 tests, 10 suite-level errors, 5 errors, 10 failures

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 20 suites, 120 tests, 10 suite-level errors, 5 errors, 10 failures [seed: 8EF5B43ED017BC9]

Total time: 6 minutes 9 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.SSLMigrationTest
[repro]   5/5 failed: org.apache.solr.cloud.ZkControllerTest
[repro]   5/5 failed: org.apache.solr.core.TestJmxIntegration
[repro]   5/5 failed: org.apache.solr.handler.TestReplicationHandler
[repro]   5/5 failed: org.apache.solr.ltr.TestLTRReRankingPipeline
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=1fe45606b91b368b5fcd20e3c86e401ab4f9c6a6, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21542
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21543 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21543/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC

8 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)  at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)  at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)  at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)  at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)  at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)  at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)  at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [InternalHttpClient, InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:236)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:223)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.constructClient(LBHttpSolrClient.java:292)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.<init>(LBHttpSolrClient.java:270)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient$Builder.build(LBHttpSolrClient.java:967)
	at org.apache.solr.SolrTestCaseJ4.getLBHttpSolrClient(SolrTestCaseJ4.java:2473)
	at org.apache.solr.cloud.SSLMigrationTest.setUrlScheme(SSLMigrationTest.java:132)
	at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
	at org.apache.solr.cloud.SSLMigrationTest.test(SSLMigrationTest.java:60)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:297)
	at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest:     1) Thread[id=7449, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=7310, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SSLMigrationTest: 
   1) Thread[id=7449, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=7310, name=Connection evictor, state=TIMED_WAITING, group=TGRP-SSLMigrationTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8]:0)


FAILED:  org.apache.solr.cloud.autoscaling.HdfsAutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:40629_solr, 127.0.0.1:46015_solr] Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/13)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node3/data/",           "base_url":"http://127.0.0.1:46015/solr",           "node_name":"127.0.0.1:46015_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node3/data/tlog",           "core":"testSimple1_shard1_replica_n1",           "shared_storage":"true",           "state":"active",           "leader":"true"},         "core_node5":{           "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node5/data/",           "base_url":"http://127.0.0.1:46015/solr",           "node_name":"127.0.0.1:46015_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node5/data/tlog",           "core":"testSimple1_shard1_replica_n2",           "shared_storage":"true",           "state":"active"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node7":{           "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node7/data/",           "base_url":"http://127.0.0.1:46015/solr",           "node_name":"127.0.0.1:46015_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node7/data/tlog",           "core":"testSimple1_shard2_replica_n4",           "shared_storage":"true",           "state":"active",           "leader":"true"},         "core_node8":{           "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node8/data/",           "base_url":"http://127.0.0.1:39395/solr",           "node_name":"127.0.0.1:39395_solr",           "type":"NRT",           "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node8/data/tlog",           "core":"testSimple1_shard2_replica_n6",           "shared_storage":"true",           "state":"down"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:40629_solr, 127.0.0.1:46015_solr]
Last available state: DocCollection(testSimple1//collections/testSimple1/state.json/13)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node3/data/",
          "base_url":"http://127.0.0.1:46015/solr",
          "node_name":"127.0.0.1:46015_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node3/data/tlog",
          "core":"testSimple1_shard1_replica_n1",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"},
        "core_node5":{
          "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node5/data/",
          "base_url":"http://127.0.0.1:46015/solr",
          "node_name":"127.0.0.1:46015_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node5/data/tlog",
          "core":"testSimple1_shard1_replica_n2",
          "shared_storage":"true",
          "state":"active"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node7/data/",
          "base_url":"http://127.0.0.1:46015/solr",
          "node_name":"127.0.0.1:46015_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node7/data/tlog",
          "core":"testSimple1_shard2_replica_n4",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"},
        "core_node8":{
          "dataDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node8/data/",
          "base_url":"http://127.0.0.1:39395/solr",
          "node_name":"127.0.0.1:39395_solr",
          "type":"NRT",
          "ulogDir":"hdfs://localhost.localdomain:41029/data/testSimple1/core_node8/data/tlog",
          "core":"testSimple1_shard2_replica_n6",
          "shared_storage":"true",
          "state":"down"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8:105A41D16ED26269]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates

Error Message:
The ZkController.publishAndWaitForDownStates should have timed out but it didn't

Stack Trace:
java.lang.AssertionError: The ZkController.publishAndWaitForDownStates should have timed out but it didn't
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8:FE609C3E8B6F987]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.ZkControllerTest.testPublishAndWaitForDownStates(ZkControllerTest.java:306)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload

Error Message:
Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>

Stack Trace:
java.lang.AssertionError: Number of registered MBeans is not the same as info registry size expected:<107> but was:<0>
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8:2A50BE433A626A75]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.TestJmxIntegration.testJmxOnCoreReload(TestJmxIntegration.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart

Error Message:
IOException occured when talking to server at: http://127.0.0.1:33975/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33975/solr/collection1
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8:F01EA1CBE2FA74E4]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.TestReplicationHandler.index(TestReplicationHandler.java:180)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexFetchOnMasterRestart(TestReplicationHandler.java:643)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:33975 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 47 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
	at __randomizedtesting.SeedInfo.seed([C9958078AAD0E96E:3834F2289F6B23FC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.junit.Assert.assertEquals(Assert.java:512)
	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([28E9652F4921B6B8:4DB12A2C5E5C03C]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:904)
	at org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=cat:mxy7hesfr0lllijkmg45+achzzqrp0mcywrg4v5lm+u71i8f5r6iy6f6qdmps3+luzxcb1nbkcovaleq0sk+sn3w8f6o98891wipvqzw&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:897)
	... 40 more




Build Log:
[...truncated 12741 lines...]
   [junit4] Suite: org.apache.solr.cloud.SSLMigrationTest
   [junit4]   2> 603653 INFO  (SUITE-SSLMigrationTest-seed#[28E9652F4921B6B8]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/init-core-data-001
   [junit4]   2> 603653 WARN  (SUITE-SSLMigrationTest-seed#[28E9652F4921B6B8]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 603653 INFO  (SUITE-SSLMigrationTest-seed#[28E9652F4921B6B8]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 603655 INFO  (SUITE-SSLMigrationTest-seed#[28E9652F4921B6B8]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 603655 INFO  (SUITE-SSLMigrationTest-seed#[28E9652F4921B6B8]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 603656 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 603656 INFO  (Thread-3029) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 603656 INFO  (Thread-3029) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 603657 ERROR (Thread-3029) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 603756 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.ZkTestServer start zk server on port:35257
   [junit4]   2> 603759 INFO  (zkConnectionManagerCallback-1076-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 603761 INFO  (zkConnectionManagerCallback-1078-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 603764 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 603765 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 603765 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 603766 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 603766 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 603766 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 603767 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 603767 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 603768 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 603768 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 603768 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 603769 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 603837 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 603838 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 603838 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 603838 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 603839 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18b0a30{/,null,AVAILABLE}
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@402d83{HTTP/1.1,[http/1.1]}{127.0.0.1:42707}
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.Server Started @605430ms
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=42707, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/control-001/cores}
   [junit4]   2> 603840 ERROR (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 603840 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T06:05:44.089Z
   [junit4]   2> 603841 INFO  (zkConnectionManagerCallback-1080-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 603843 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 603843 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/control-001/solr.xml
   [junit4]   2> 603845 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 603845 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 603846 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 603848 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35257/solr
   [junit4]   2> 603850 INFO  (zkConnectionManagerCallback-1084-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 603854 INFO  (zkConnectionManagerCallback-1086-thread-1-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 603881 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 603882 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42707_
   [junit4]   2> 603882 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.c.Overseer Overseer (id=72219776261750788-127.0.0.1:42707_-n_0000000000) starting
   [junit4]   2> 603885 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42707_
   [junit4]   2> 603885 INFO  (zkCallback-1085-thread-1-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 604003 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 604010 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 604011 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 604012 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:42707_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/control-001/cores
   [junit4]   2> 604026 INFO  (zkConnectionManagerCallback-1092-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 604027 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 604028 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35257/solr ready
   [junit4]   2> 604029 INFO  (qtp7120695-7121) [n:127.0.0.1:42707_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:42707_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 604030 INFO  (OverseerThreadFactory-2319-thread-1-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 604134 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 604134 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 604237 INFO  (zkCallback-1085-thread-1-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 605177 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 605196 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 605245 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 605254 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 605254 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 605254 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 605254 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 605256 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6420551215497532]
   [junit4]   2> 605258 WARN  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 605287 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 605287 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 605288 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 605288 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 605289 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.510568864109005]
   [junit4]   2> 605289 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@19e96a[control_collection_shard1_replica_n1] main]
   [junit4]   2> 605290 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 605290 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 605290 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 605291 INFO  (searcherExecutor-2322-thread-1-processing-n:127.0.0.1:42707_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@19e96a[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 605291 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593533053576151040
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42707/control_collection_shard1_replica_n1/
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:42707/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 605296 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 605297 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42707/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 605398 INFO  (zkCallback-1085-thread-2-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 605448 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 605450 INFO  (qtp7120695-7157) [n:127.0.0.1:42707_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1316
   [junit4]   2> 605452 INFO  (qtp7120695-7121) [n:127.0.0.1:42707_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 605551 INFO  (zkCallback-1085-thread-2-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 606031 INFO  (OverseerCollectionConfigSetProcessor-72219776261750788-127.0.0.1:42707_-n_0000000000) [n:127.0.0.1:42707_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 606453 INFO  (qtp7120695-7121) [n:127.0.0.1:42707_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:42707_&wt=javabin&version=2} status=0 QTime=2423
   [junit4]   2> 606456 INFO  (zkConnectionManagerCallback-1096-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 606457 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 606458 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35257/solr ready
   [junit4]   2> 606458 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 606458 INFO  (qtp7120695-7156) [n:127.0.0.1:42707_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 606460 INFO  (OverseerThreadFactory-2319-thread-2-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 606460 WARN  (OverseerThreadFactory-2319-thread-2-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 606664 INFO  (qtp7120695-7156) [n:127.0.0.1:42707_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 606664 INFO  (qtp7120695-7156) [n:127.0.0.1:42707_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=205
   [junit4]   2> 606732 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/shard-1-001 of type NRT
   [junit4]   2> 606732 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 606733 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 606733 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 606733 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 606733 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@116762f{/,null,AVAILABLE}
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@b114cb{HTTP/1.1,[http/1.1]}{127.0.0.1:34889}
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.e.j.s.Server Started @608324ms
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=34889, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/shard-1-001/cores}
   [junit4]   2> 606734 ERROR (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 606734 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T06:05:46.983Z
   [junit4]   2> 606735 INFO  (zkConnectionManagerCallback-1098-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 606736 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 606736 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/shard-1-001/solr.xml
   [junit4]   2> 606738 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 606738 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 606739 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 606741 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35257/solr
   [junit4]   2> 606742 INFO  (zkConnectionManagerCallback-1102-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 606744 INFO  (zkConnectionManagerCallback-1104-thread-1-processing-n:127.0.0.1:34889_) [n:127.0.0.1:34889_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 606747 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 606748 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 606748 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34889_
   [junit4]   2> 606749 INFO  (zkCallback-1085-thread-1-processing-n:127.0.0.1:42707_) [n:127.0.0.1:42707_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 606749 INFO  (zkCallback-1095-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 606749 INFO  (zkCallback-1103-thread-1-processing-n:127.0.0.1:34889_) [n:127.0.0.1:34889_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 606827 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 606834 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 606835 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4f1e5
   [junit4]   2> 606836 INFO  (TEST-SSLMigrationTest.test-seed#[28E9652F4921B6B8]) [n:127.0.0.1:34889_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest_28E9652F4921B6B8-001/shard-1-001/cores
   [junit4]   2> 606856 INFO  (qtp2592574-7174) [n:127.0.0.1:34889_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34889_&ac

[...truncated too long message...]

8))), cat=PostingsFormat(name=Memory), id=FSTOrd50, text=PostingsFormat(name=MockRandom), title=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), title_lettertok=FSTOrd50}, docValues:{int_i=DocValuesFormat(name=Lucene70), range_facet_l_dv=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Memory), intDefault=DocValuesFormat(name=Memory), id_i1=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Lucene70), count_i=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Memory), range_facet_l=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1509, maxMBSortInHeap=6.377771837094007, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1d2d1f2), locale=nl, timezone=Pacific/Majuro
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=269212072,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestDynamicFieldResource, ConcurrentCreateRoutedAliasTest, BigEndianAscendingWordDeserializerTest, TestSolrXml, CachingDirectoryFactoryTest, DateRangeFieldTest, DirectUpdateHandlerTest, TestEmbeddedSolrServerSchemaAPI, TestAddFieldRealTimeGet, InfoHandlerTest, TestInitQParser, TestIBSimilarityFactory, TestWordDelimiterFilterFactory, TestFastOutputStream, CursorPagingTest, TestDocSet, TestQuerySenderNoQuery, DirectoryFactoryTest, SolrPluginUtilsTest, TestStandardQParsers, TestExpandComponent, OverseerStatusTest, TestDistributedSearch, TestSolrDeletionPolicy1, TestOverriddenPrefixQueryForCustomFieldType, ExplicitHLLTest, TestFreeTextSuggestions, DataDrivenBlockJoinTest, OutputWriterTest, TriLevelCompositeIdRoutingTest, TestCoreAdminApis, AddBlockUpdateTest, SolrIndexSplitterTest, BooleanFieldTest, TestLuceneMatchVersion, OpenExchangeRatesOrgProviderTest, MigrateRouteKeyTest, TestSkipOverseerOperations, TestManagedSynonymFilterFactory, SolrSlf4jReporterTest, TestReRankQParserPlugin, TestDocBasedVersionConstraints, TestSerializedLuceneMatchVersion, SolrXmlInZkTest, MetricTriggerTest, BlockDirectoryTest, GraphQueryTest, XmlUpdateRequestHandlerTest, TestTolerantUpdateProcessorRandomCloud, SearchRateTriggerTest, TestSegmentSorting, HdfsTlogReplayBufferedWhileIndexingTest, TestPHPSerializedResponseWriter, TestMergePolicyConfig, FullSolrCloudDistribCmdsTest, TestQueryWrapperFilter, TimeRoutedAliasUpdateProcessorTest, TestHashPartitioner, SolrMetricReporterTest, TestUseDocValuesAsStored2, SuggestComponentContextFilterQueryTest, TestSolrQueryParser, TestBinaryField, TestExclusionRuleCollectionAccess, SuggesterWFSTTest, TermVectorComponentDistributedTest, TestPolicyCloud, ExternalFileFieldSortTest, TestOmitPositions, TestCSVResponseWriter, V2ApiIntegrationTest, TestLegacyFieldReuse, DeleteLastCustomShardedReplicaTest, ExecutePlanActionTest, TestFieldCacheReopen, TestSchemaResource, EchoParamsTest, TestExactSharedStatsCache, LIRRollingUpdatesTest, ZkStateWriterTest, DistributedSuggestComponentTest, TestCollationField, TestHighlightDedupGrouping, TestPseudoReturnFields, TestStressLucene, ResponseHeaderTest, TestDFISimilarityFactory, TestRestoreCore, DistribDocExpirationUpdateProcessorTest, TestCloudInspectUtil, TestSearcherReuse, RequestHandlersTest, TestApiFramework, RollingRestartTest, TestConfigSetsAPIZkFailure, HdfsBasicDistributedZkTest, AssignBackwardCompatibilityTest, UUIDFieldTest, TestBlobHandler, SolrCoreCheckLockOnStartupTest, MoveReplicaHDFSTest, TestWriterPerf, TestDocumentBuilder, TestOnReconnectListenerSupport, DefaultValueUpdateProcessorTest, TestSchemalessBufferedUpdates, ChaosMonkeyNothingIsSafeTest, FieldAnalysisRequestHandlerTest, RulesTest, TestAuthorizationFramework, RequestLoggingTest, HLLUtilTest, TestLargeCluster, TestXmlQParser, ActionThrottleTest, BlockJoinFacetDistribTest, BasicDistributedZkTest, HdfsNNFailoverTest, ZkShardTermsTest, TestUnifiedSolrHighlighter, ZkCLITest, TestManagedResource, DistanceUnitsTest, SynonymTokenizerTest, TestSort, TestClusterProperties, DistributedExpandComponentTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler, TestRandomDVFaceting, DistributedSpellCheckComponentTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, TestRangeQuery, TestConfig, TestPhraseSuggestions, TestXIncludeConfig, TestLMDirichletSimilarityFactory, TimeZoneUtilsTest, URLClassifyProcessorTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, TestLRUCache, TestCursorMarkWithoutUniqueKey, TestLuceneIndexBackCompat, CloudExitableDirectoryReaderTest, ConnectionManagerTest, DeleteInactiveReplicaTest, DeleteShardTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, LeaderFailureAfterFreshStartTest, MoveReplicaTest, NodeMutatorTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, PeerSyncReplicationTest, SolrCloudExampleTest, TestDistributedMap, TestLeaderElectionWithEmptyReplica, TestRandomRequestDistribution, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestUtilizeNode, CollectionsAPIAsyncDistributedZkTest, TestHdfsCloudBackupRestore, TestLocalFSCloudBackupRestore, AutoAddReplicasIntegrationTest, HttpTriggerListenerTest, NodeAddedTriggerTest, NodeLostTriggerTest, TestPolicyCloud, TriggerIntegrationTest, TestSystemCollAutoCreate, CoreAdminCreateDiscoverTest, PropertiesRequestHandlerTest, SecurityConfHandlerTest, SegmentsInfoRequestHandlerTest, CustomHighlightComponentTest, DistributedFacetPivotSmallAdvancedTest, DistributedQueryComponentCustomSortTest, ShufflingReplicaListTransformerTest, TestDistributedStatsComponentCardinality, MetricsConfigTest, SolrMetricManagerTest, SolrGraphiteReporterTest, SolrJmxReporterTest, RegexBytesRefFilterTest, SubstringBytesRefFilterTest, TestIntervalFaceting, TestCloudManagedSchema, TestPointFields, CurrencyRangeFacetCloudTest, TestComplexPhraseQParserPlugin, TestMaxScoreQueryParser, TestNoOpRegenerator, TestReloadDeadlock, TestSmileRequest, TestJsonFacets, HttpSolrCallGetCoreTest, HdfsLockFactoryTest, TestFieldCacheWithThreads, TestLegacyFieldCache, TestNumericTerms32, VersionInfoTest, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [761/778 (6!)] on J0 in 0.51s, 4 tests, 1 error <<< FAILURES!

[...truncated 46 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J2-20180227_055538_6302121245127340857279.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid28482.hprof ...
   [junit4] Heap dump file created [333890004 bytes in 0.712 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 7424 lines...]
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4]   2> 2805 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[C9958078AAD0E96E]) [    ] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 2805 INFO  (TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[C9958078AAD0E96E]) [    ] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN -Dtests.seed=C9958078AAD0E96E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-DZ -Dtests.timezone=Asia/Ujung_Pandang -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.06s J0 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but was:<0.0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C9958078AAD0E96E:3834F2289F6B23FC]:0)
   [junit4]    > 	at org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {field=PostingsFormat(name=Direct), id=PostingsFormat(name=Asserting), final-score=PostingsFormat(name=Asserting)}, docValues:{final-score=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=718, maxMBSortInHeap=6.3355656676422845, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@17a78bb), locale=ar-DZ, timezone=Asia/Ujung_Pandang
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=28028952,total=67108864
   [junit4]   2> NOTE: All tests run in this JVM: [TestWrapperModel, TestLTRReRankingPipeline]
   [junit4] Completed [5/36 (1!)] on J0 in 0.60s, 3 tests, 1 failure <<< FAILURES!

[...truncated 1282 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:618: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:570: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid28482.hprof

Total time: 81 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21542 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21542/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestSegmentSorting.testSegmentTerminateEarly

Error Message:
expected:<COMPLETED> but was:<RUNNING>

Stack Trace:
java.lang.AssertionError: expected:<COMPLETED> but was:<RUNNING>
	at __randomizedtesting.SeedInfo.seed([6137223F699FA748:B191E592B5CD3322]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.cloud.TestSegmentSorting.createCollection(TestSegmentSorting.java:84)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:47)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12317 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSegmentSorting
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/init-core-data-001
   [junit4]   2> 362132 WARN  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=49 numCloses=49
   [junit4]   2> 362132 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 362134 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 362134 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 362135 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001
   [junit4]   2> 362135 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 362135 INFO  (Thread-1241) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 362135 INFO  (Thread-1241) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 362136 ERROR (Thread-1241) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 362235 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38871
   [junit4]   2> 362238 INFO  (zkConnectionManagerCallback-4115-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362241 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 362241 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 362241 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 362245 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 362246 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 362268 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 362268 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 362268 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 362272 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 362272 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 362273 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 362273 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18d7d4e{/solr,null,AVAILABLE}
   [junit4]   2> 362282 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@a0f6bc{SSL,[ssl, http/1.1]}{127.0.0.1:35819}
   [junit4]   2> 362282 INFO  (jetty-launcher-4112-thread-5) [    ] o.e.j.s.Server Started @363914ms
   [junit4]   2> 362282 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35819}
   [junit4]   2> 362282 ERROR (jetty-launcher-4112-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 362282 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T03:01:08.236Z
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 362283 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 362284 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ee2ed6{/solr,null,AVAILABLE}
   [junit4]   2> 362294 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9901a1{/solr,null,AVAILABLE}
   [junit4]   2> 362294 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@c52f4b{/solr,null,AVAILABLE}
   [junit4]   2> 362297 INFO  (zkConnectionManagerCallback-4117-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362297 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@97dede{SSL,[ssl, http/1.1]}{127.0.0.1:41345}
   [junit4]   2> 362297 INFO  (jetty-launcher-4112-thread-2) [    ] o.e.j.s.Server Started @363929ms
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41345}
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 362298 ERROR (jetty-launcher-4112-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 362298 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T03:01:08.251Z
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@c49738{SSL,[ssl, http/1.1]}{127.0.0.1:45305}
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3b4077{SSL,[ssl, http/1.1]}{127.0.0.1:36949}
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-4) [    ] o.e.j.s.Server Started @363937ms
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-3) [    ] o.e.j.s.Server Started @363937ms
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45305}
   [junit4]   2> 362305 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36949}
   [junit4]   2> 362306 ERROR (jetty-launcher-4112-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 362306 ERROR (jetty-launcher-4112-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T03:01:08.259Z
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 362306 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T03:01:08.259Z
   [junit4]   2> 362309 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 362309 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 362309 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 362326 INFO  (zkConnectionManagerCallback-4119-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362326 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 362345 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ccd66b{/solr,null,AVAILABLE}
   [junit4]   2> 362349 INFO  (zkConnectionManagerCallback-4121-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@14f72c2{SSL,[ssl, http/1.1]}{127.0.0.1:41251}
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.e.j.s.Server Started @363981ms
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41251}
   [junit4]   2> 362350 ERROR (jetty-launcher-4112-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 362350 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-27T03:01:08.303Z
   [junit4]   2> 362353 INFO  (jetty-launcher-4112-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38871/solr
   [junit4]   2> 362367 INFO  (zkConnectionManagerCallback-4123-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362389 INFO  (zkConnectionManagerCallback-4126-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362389 INFO  (jetty-launcher-4112-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38871/solr
   [junit4]   2> 362390 INFO  (jetty-launcher-4112-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38871/solr
   [junit4]   2> 362393 INFO  (zkConnectionManagerCallback-4129-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362390 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 362390 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 362465 INFO  (zkConnectionManagerCallback-4135-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362465 INFO  (zkConnectionManagerCallback-4137-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362466 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10092d7fcee0008, likely client has closed socket
   [junit4]   2> 362470 INFO  (jetty-launcher-4112-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38871/solr
   [junit4]   2> 362494 INFO  (zkConnectionManagerCallback-4139-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362502 INFO  (zkConnectionManagerCallback-4142-thread-1-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362498 INFO  (zkConnectionManagerCallback-4147-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362502 INFO  (jetty-launcher-4112-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38871/solr
   [junit4]   2> 362506 INFO  (zkConnectionManagerCallback-4145-thread-1-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362512 INFO  (zkConnectionManagerCallback-4153-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362518 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 362521 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 362521 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41345_solr
   [junit4]   2> 362522 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.c.Overseer Overseer (id=72219050397007884-127.0.0.1:41345_solr-n_0000000000) starting
   [junit4]   2> 362534 INFO  (zkConnectionManagerCallback-4151-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362535 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45305_solr
   [junit4]   2> 362560 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 362562 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 362562 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 362563 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35819_solr
   [junit4]   2> 362585 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 362586 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36949_solr
   [junit4]   2> 362630 INFO  (zkCallback-4144-thread-1-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 362630 INFO  (zkCallback-4152-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 362630 INFO  (zkCallback-4138-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 362631 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 362632 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41345_solr
   [junit4]   2> 362650 INFO  (zkCallback-4138-thread-2-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 362650 INFO  (zkCallback-4144-thread-3-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 362660 INFO  (zkCallback-4152-thread-2-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 362698 INFO  (zkCallback-4141-thread-1-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
   [junit4]   2> 362701 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362698 INFO  (zkConnectionManagerCallback-4159-thread-1-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362704 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 362705 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 362706 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41251_solr
   [junit4]   2> 362707 INFO  (zkCallback-4152-thread-2-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 362707 INFO  (zkCallback-4138-thread-2-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 362707 INFO  (zkCallback-4144-thread-2-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 362707 INFO  (zkCallback-4141-thread-1-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 362708 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35819.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362710 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36949.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362713 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362713 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362714 INFO  (zkCallback-4158-thread-1-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 362715 INFO  (jetty-launcher-4112-thread-4) [n:127.0.0.1:45305_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node4/.
   [junit4]   2> 362716 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35819.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362716 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35819.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362717 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36949.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362718 INFO  (jetty-launcher-4112-thread-5) [n:127.0.0.1:35819_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node5/.
   [junit4]   2> 362718 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36949.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362718 INFO  (jetty-launcher-4112-thread-3) [n:127.0.0.1:36949_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node3/.
   [junit4]   2> 362736 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41345.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362743 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41345.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362743 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41345.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362744 INFO  (jetty-launcher-4112-thread-2) [n:127.0.0.1:41345_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node2/.
   [junit4]   2> 362764 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362771 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362772 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 362773 INFO  (jetty-launcher-4112-thread-1) [n:127.0.0.1:41251_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node1/.
   [junit4]   2> 362938 INFO  (zkConnectionManagerCallback-4167-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362939 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10092d7fcee0010, likely client has closed socket
   [junit4]   2> 362940 INFO  (zkConnectionManagerCallback-4171-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 362941 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 362941 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38871/solr ready
   [junit4]   2> 363121 INFO  (TEST-TestSegmentSorting.testAtomicUpdateOfSegmentSortField-seed#[6137223F699FA748]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAtomicUpdateOfSegmentSortField
   [junit4]   2> 363161 INFO  (qtp26783295-9755) [n:127.0.0.1:41345_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=f5744eeb-6702-4d19-8be9-f326ec165fb0&replicationFactor=2&property.config=solrconfig-sortingmergepolicyfactory.xml&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&name=testAtomicUpdateOfSegmentSortField&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 363162 INFO  (qtp26783295-9755) [n:127.0.0.1:41345_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=f5744eeb-6702-4d19-8be9-f326ec165fb0&replicationFactor=2&property.config=solrconfig-sortingmergepolicyfactory.xml&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&name=testAtomicUpdateOfSegmentSortField&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 363163 INFO  (qtp26783295-9763) [n:127.0.0.1:41345_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 363163 INFO  (OverseerThreadFactory-1439-thread-1-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testAtomicUpdateOfSegmentSortField
   [junit4]   2> 363163 INFO  (qtp26783295-9763) [n:127.0.0.1:41345_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 363268 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testAtomicUpdateOfSegmentSortField",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testAtomicUpdateOfSegmentSortField_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:45305/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 363269 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testAtomicUpdateOfSegmentSortField",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testAtomicUpdateOfSegmentSortField_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36949/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 363270 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testAtomicUpdateOfSegmentSortField",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testAtomicUpdateOfSegmentSortField_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35819/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 363271 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testAtomicUpdateOfSegmentSortField",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testAtomicUpdateOfSegmentSortField_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41251/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 363520 INFO  (qtp29148350-9768) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node3&name=testAtomicUpdateOfSegmentSortField_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=0
   [junit4]   2> 363520 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node3&name=testAtomicUpdateOfSegmentSortField_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 363520 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 363527 INFO  (qtp25196603-9761) [n:127.0.0.1:36949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node5&name=testAtomicUpdateOfSegmentSortField_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=0
   [junit4]   2> 363528 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node5&name=testAtomicUpdateOfSegmentSortField_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 363529 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 363535 INFO  (qtp28257660-9765) [n:127.0.0.1:41251_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node8&name=testAtomicUpdateOfSegmentSortField_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=3
   [junit4]   2> 363535 INFO  (qtp21648456-9754) [n:127.0.0.1:35819_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node7&name=testAtomicUpdateOfSegmentSortField_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=3
   [junit4]   2> 363535 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node8&name=testAtomicUpdateOfSegmentSortField_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 363535 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 363537 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=class+org.apache.solr.cloud.TestSegmentSorting_configSet&newCollection=true&collection=testAtomicUpdateOfSegmentSortField&version=2&replicaType=NRT&async=f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970&property.config=solrconfig-sortingmergepolicyfactory.xml&coreNodeName=core_node7&name=testAtomicUpdateOfSegmentSortField_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 363541 INFO  (qtp29148350-9771) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891
   [junit4]   2> 363541 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 363558 INFO  (qtp29148350-9771) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=16
   [junit4]   2> 363663 INFO  (zkCallback-4138-thread-2-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363663 INFO  (zkCallback-4158-thread-1-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363663 INFO  (zkCallback-4152-thread-2-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363663 INFO  (zkCallback-4138-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363663 INFO  (zkCallback-4141-thread-1-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363669 INFO  (zkCallback-4158-thread-2-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363669 INFO  (zkCallback-4152-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 363677 INFO  (zkCallback-4141-thread-2-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 364164 INFO  (qtp26783295-9755) [n:127.0.0.1:41345_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 364165 INFO  (qtp26783295-9755) [n:127.0.0.1:41345_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 364535 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 364542 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.s.IndexSchema [testAtomicUpdateOfSegmentSortField_shard1_replica_n1] Schema name=test
   [junit4]   2> 364582 INFO  (qtp29148350-9768) [n:127.0.0.1:45305_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891
   [junit4]   2> 364583 INFO  (qtp29148350-9768) [n:127.0.0.1:45305_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 364597 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 364601 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 364608 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.s.IndexSchema [testAtomicUpdateOfSegmentSortField_shard2_replica_n6] Schema name=test
   [junit4]   2> 364631 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 364635 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.s.IndexSchema [testAtomicUpdateOfSegmentSortField_shard2_replica_n4] Schema name=test
   [junit4]   2> 364641 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.s.IndexSchema [testAtomicUpdateOfSegmentSortField_shard1_replica_n2] Schema name=test
   [junit4]   2> 364836 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 364862 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testAtomicUpdateOfSegmentSortField_shard2_replica_n4' using configuration from collection testAtomicUpdateOfSegmentSortField, trusted=true
   [junit4]   2> 364864 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 364865 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35819.solr.core.testAtomicUpdateOfSegmentSortField.shard2.replica_n4' (registry 'solr.core.testAtomicUpdateOfSegmentSortField.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 364865 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 364865 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.SolrCore [[testAtomicUpdateOfSegmentSortField_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node5/testAtomicUpdateOfSegmentSortField_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node5/./testAtomicUpdateOfSegmentSortField_shard2_replica_n4/data/]
   [junit4]   2> 364870 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5209548398245717])
   [junit4]   2> 364873 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 364891 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 364912 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testAtomicUpdateOfSegmentSortField_shard1_replica_n1' using configuration from collection testAtomicUpdateOfSegmentSortField, trusted=true
   [junit4]   2> 364912 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45305.solr.core.testAtomicUpdateOfSegmentSortField.shard1.replica_n1' (registry 'solr.core.testAtomicUpdateOfSegmentSortField.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 364913 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 364913 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.SolrCore [[testAtomicUpdateOfSegmentSortField_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node4/testAtomicUpdateOfSegmentSortField_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node4/./testAtomicUpdateOfSegmentSortField_shard1_replica_n1/data/]
   [junit4]   2> 364915 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5209548398245717])
   [junit4]   2> 364992 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testAtomicUpdateOfSegmentSortField_shard1_replica_n2' using configuration from collection testAtomicUpdateOfSegmentSortField, trusted=true
   [junit4]   2> 364993 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36949.solr.core.testAtomicUpdateOfSegmentSortField.shard1.replica_n2' (registry 'solr.core.testAtomicUpdateOfSegmentSortField.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 364993 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 364993 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.c.SolrCore [[testAtomicUpdateOfSegmentSortField_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node3/testAtomicUpdateOfSegmentSortField_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node3/./testAtomicUpdateOfSegmentSortField_shard1_replica_n2/data/]
   [junit4]   2> 364995 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5209548398245717])
   [junit4]   2> 365014 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testAtomicUpdateOfSegmentSortField_shard2_replica_n6' using configuration from collection testAtomicUpdateOfSegmentSortField, trusted=true
   [junit4]   2> 365014 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.core.testAtomicUpdateOfSegmentSortField.shard2.replica_n6' (registry 'solr.core.testAtomicUpdateOfSegmentSortField.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@102fde
   [junit4]   2> 365014 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 365014 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.c.SolrCore [[testAtomicUpdateOfSegmentSortField_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node1/testAtomicUpdateOfSegmentSortField_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001/tempDir-001/node1/./testAtomicUpdateOfSegmentSortField_shard2_replica_n6/data/]
   [junit4]   2> 365017 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5209548398245717])
   [junit4]   2> 365029 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 365029 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 365031 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 365031 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 365032 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8276069092059789])
   [junit4]   2> 365033 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@14e35b2[testAtomicUpdateOfSegmentSortField_shard1_replica_n1] main]
   [junit4]   2> 365034 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 365034 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 365035 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365035 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 365035 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365035 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 365037 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 365038 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8276069092059789])
   [junit4]   2> 365039 INFO  (searcherExecutor-1451-thread-1-processing-x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1 r:core_node3 f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE n:127.0.0.1:45305_solr s:shard1 c:testAtomicUpdateOfSegmentSortField) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.SolrCore [testAtomicUpdateOfSegmentSortField_shard1_replica_n1] Registered new searcher Searcher@14e35b2[testAtomicUpdateOfSegmentSortField_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 365039 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593521441070907392
   [junit4]   2> 365040 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@89aa36[testAtomicUpdateOfSegmentSortField_shard2_replica_n4] main]
   [junit4]   2> 365041 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365041 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365042 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 365042 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593521441074053120
   [junit4]   2> 365046 INFO  (searcherExecutor-1450-thread-1-processing-x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4 r:core_node7 f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE n:127.0.0.1:35819_solr s:shard2 c:testAtomicUpdateOfSegmentSortField) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.SolrCore [testAtomicUpdateOfSegmentSortField_shard2_replica_n4] Registered new searcher Searcher@89aa36[testAtomicUpdateOfSegmentSortField_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 365051 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 365052 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 365105 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 365106 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 365133 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 365133 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 365133 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 365133 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 365134 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8276069092059789])
   [junit4]   2> 365134 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@11c607c[testAtomicUpdateOfSegmentSortField_shard1_replica_n2] main]
   [junit4]   2> 365134 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 365134 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 365135 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365135 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365135 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.ForceMergePolicy: ForceMergePolicy([LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8276069092059789])
   [junit4]   2> 365135 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 365136 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@16a31b3[testAtomicUpdateOfSegmentSortField_shard2_replica_n6] main]
   [junit4]   2> 365136 INFO  (parallelCoreAdminExecutor-1442-thread-1-processing-n:127.0.0.1:36949_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593521441172619264
   [junit4]   2> 365137 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365137 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 365138 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 365142 INFO  (searcherExecutor-1452-thread-1-processing-x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2 r:core_node5 f5744eeb-6702-4d19-8be9-f326ec165fb02463629659353106 CREATE n:127.0.0.1:36949_solr s:shard1 c:testAtomicUpdateOfSegmentSortField) [n:127.0.0.1:36949_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node5 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n2] o.a.s.c.SolrCore [testAtomicUpdateOfSegmentSortField_shard1_replica_n2] Registered new searcher Searcher@11c607c[testAtomicUpdateOfSegmentSortField_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 365143 INFO  (searcherExecutor-1455-thread-1-processing-x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6 r:core_node8 f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE n:127.0.0.1:41251_solr s:shard2 c:testAtomicUpdateOfSegmentSortField) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.c.SolrCore [testAtomicUpdateOfSegmentSortField_shard2_replica_n6] Registered new searcher Searcher@16a31b3[testAtomicUpdateOfSegmentSortField_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 365143 INFO  (parallelCoreAdminExecutor-1448-thread-1-processing-n:127.0.0.1:41251_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629661370436 CREATE) [n:127.0.0.1:41251_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node8 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593521441179959296
   [junit4]   2> 365152 INFO  (zkCallback-4158-thread-1-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365152 INFO  (zkCallback-4138-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365152 INFO  (zkCallback-4152-thread-1-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365152 INFO  (zkCallback-4138-thread-2-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365152 INFO  (zkCallback-4158-thread-2-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365152 INFO  (zkCallback-4152-thread-2-processing-n:127.0.0.1:45305_solr) [n:127.0.0.1:45305_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365153 INFO  (zkCallback-4141-thread-1-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365153 INFO  (zkCallback-4141-thread-2-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testAtomicUpdateOfSegmentSortField/state.json] for collection [testAtomicUpdateOfSegmentSortField] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 365166 INFO  (qtp26783295-9763) [n:127.0.0.1:41345_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 365167 INFO  (qtp26783295-9763) [n:127.0.0.1:41345_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=f5744eeb-6702-4d19-8be9-f326ec165fb0&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45305/solr/testAtomicUpdateOfSegmentSortField_shard1_replica_n1/
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35819/solr/testAtomicUpdateOfSegmentSortField_shard2_replica_n4/
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1440-thread-1-processing-n:127.0.0.1:45305_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629658382891 CREATE) [n:127.0.0.1:45305_solr c:testAtomicUpdateOfSegmentSortField s:shard1 r:core_node3 x:testAtomicUpdateOfSegmentSortField_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testAtomicUpdateOfSegmentSortField_shard1_replica_n1 url=https://127.0.0.1:45305/solr START replicas=[https://127.0.0.1:36949/solr/testAtomicUpdateOfSegmentSortField_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 365552 INFO  (parallelCoreAdminExecutor-1441-thread-1-processing-n:127.0.0.1:35819_solr f5744eeb-6702-4d19-8be9-f326ec165fb02463629660370970 CREATE) [n:127.0.0.1:35819_solr c:testAtomicUpdateOfSegmentSortField s:shard2 r:core_node7 x:testAtomicUpdateOfSegmentSortField_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testAtomicUpdateOfSegmentSortField_shard2_replica_n4 url=https://127.0.0.1:35819/solr START replicas=[https://127.0.0.1:41251/solr/testAtomicUpdateOfSegmentSortField_shard2_r

[...truncated too long message...]

[junit4]   2> 425699 INFO  (jetty-closer-4113-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 425699 INFO  (jetty-closer-4113-thread-4) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18a3913: rootName = solr_35819, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1e4aa88
   [junit4]   2> 425699 INFO  (jetty-closer-4113-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36949_solr
   [junit4]   2> 425699 INFO  (zkCallback-4138-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 425699 INFO  (zkCallback-4141-thread-2-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 425699 INFO  (jetty-closer-4113-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 425699 INFO  (zkCallback-4158-thread-2-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
   [junit4]   2> 425699 INFO  (zkCallback-4144-thread-2-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 425700 INFO  (jetty-closer-4113-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 425700 INFO  (zkCallback-4141-thread-3-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
   [junit4]   2> 425700 INFO  (jetty-closer-4113-thread-5) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 425700 INFO  (zkCallback-4144-thread-3-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
   [junit4]   2> 425700 INFO  (zkCallback-4138-thread-2-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
   [junit4]   2> 425701 INFO  (zkCallback-4158-thread-1-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 425702 INFO  (jetty-closer-4113-thread-4) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35819_solr
   [junit4]   2> 425702 INFO  (jetty-closer-4113-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 425702 INFO  (zkCallback-4158-thread-2-processing-n:127.0.0.1:41251_solr) [n:127.0.0.1:41251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 425702 INFO  (zkCallback-4141-thread-3-processing-n:127.0.0.1:36949_solr) [n:127.0.0.1:36949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 425702 INFO  (zkCallback-4144-thread-2-processing-n:127.0.0.1:41345_solr) [n:127.0.0.1:41345_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 425702 INFO  (zkCallback-4138-thread-1-processing-n:127.0.0.1:35819_solr) [n:127.0.0.1:35819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 425704 INFO  (jetty-closer-4113-thread-3) [    ] o.a.s.c.Overseer Overseer (id=72219050397007884-127.0.0.1:41345_solr-n_0000000000) closing
   [junit4]   2> 425704 INFO  (OverseerStateUpdate-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41345_solr
   [junit4]   2> 425704 INFO  (jetty-closer-4113-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9901a1{/solr,null,UNAVAILABLE}
   [junit4]   2> 425704 INFO  (jetty-closer-4113-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 425704 WARN  (OverseerAutoScalingTriggerThread-72219050397007884-127.0.0.1:41345_solr-n_0000000000) [n:127.0.0.1:41345_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 425705 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10092d7fcee0009, likely client has closed socket
   [junit4]   2> 425706 INFO  (jetty-closer-4113-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1ee2ed6{/solr,null,UNAVAILABLE}
   [junit4]   2> 425706 INFO  (jetty-closer-4113-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 425706 INFO  (jetty-closer-4113-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18d7d4e{/solr,null,UNAVAILABLE}
   [junit4]   2> 425706 INFO  (jetty-closer-4113-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 427204 INFO  (jetty-closer-4113-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1ccd66b{/solr,null,UNAVAILABLE}
   [junit4]   2> 427205 INFO  (jetty-closer-4113-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 427205 ERROR (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 427205 INFO  (SUITE-TestSegmentSorting-seed#[6137223F699FA748]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38871 38871
   [junit4]   2> 432974 INFO  (Thread-1241) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38871 38871
   [junit4]   2> 432975 WARN  (Thread-1241) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/collections/testSegmentTerminateEarly/terms/shard2
   [junit4]   2> 	8	/solr/aliases.json
   [junit4]   2> 	8	/solr/collections/testAtomicUpdateOfSegmentSortField/terms/shard1
   [junit4]   2> 	8	/solr/collections/testAtomicUpdateOfSegmentSortField/terms/shard2
   [junit4]   2> 	8	/solr/configs/class org.apache.solr.cloud.TestSegmentSorting_configSet
   [junit4]   2> 	7	/solr/collections/testSegmentTerminateEarly/terms/shard1
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	40	/solr/collections/testSegmentTerminateEarly/state.json
   [junit4]   2> 	30	/solr/collections/testAtomicUpdateOfSegmentSortField/state.json
   [junit4]   2> 	8	/solr/clusterprops.json
   [junit4]   2> 	8	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72219050397007884-127.0.0.1:41345_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/collections
   [junit4]   2> 	8	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSegmentSorting_6137223F699FA748-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7d2f7d), locale=ko-KR, timezone=America/Kralendijk
   [junit4]   2> NOTE: Linux 4.13.0-32-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=83205856,total=313524224
   [junit4]   2> NOTE: All tests run in this JVM: [CursorPagingTest, RulesTest, DistributedFacetPivotWhiteBoxTest, TestSchemalessBufferedUpdates, TimeRoutedAliasUpdateProcessorTest, BigEndianAscendingWordDeserializerTest, TestQueryWrapperFilter, BaseCdcrDistributedZkTest, HdfsBasicDistributedZkTest, TestStressLiveNodes, DeleteShardTest, TermVectorComponentDistributedTest, DistribDocExpirationUpdateProcessorTest, TestCollectionsAPIViaSolrCloudCluster, SecurityConfHandlerTest, TestBinaryField, SharedFSAutoReplicaFailoverTest, InfoHandlerTest, DeleteLastCustomShardedReplicaTest, TestTrackingShardHandlerFactory, ExecutePlanActionTest, TestShardHandlerFactory, TestEmbeddedSolrServerSchemaAPI, TestMultiValuedNumericRangeQuery, RollingRestartTest, EchoParamsTest, StressHdfsTest, TestTestInjection, TestIndexSearcher, TestSegmentSorting]
   [junit4] Completed [77/778 (1!)] on J0 in 70.86s, 2 tests, 1 failure <<< FAILURES!

[...truncated 45977 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21542/consoleText

[repro] Revision: 1fc3ca0cbb2fcdd99c4a58dcf98d346e1bab5015

[repro] Ant options: "-Dargs=-server -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=TestSegmentSorting -Dtests.method=testSegmentTerminateEarly -Dtests.seed=6137223F699FA748 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko-KR -Dtests.timezone=America/Kralendijk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSegmentSorting
[repro] ant compile-test

[...truncated 3292 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestSegmentSorting" -Dtests.showOutput=onerror "-Dargs=-server -XX:+UseG1GC" -Dtests.seed=6137223F699FA748 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko-KR -Dtests.timezone=America/Kralendijk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 76 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestSegmentSorting
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21541 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21541/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseSerialGC

No tests ran.

Build Log:
[...truncated 58261 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21541/consoleText

[repro] Revision: 50c17b92bd2709ac9432dab72dc87f3873603dbc

[repro] Ant options: "-Dargs=-server -XX:+UseSerialGC"
[repro] No "reproduce with" lines found; exiting.

[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21540 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21540/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([34440A0E8887F38E:BC1035D4267B9E76]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple2 null Live Nodes: [127.0.0.1:43691_solr, 127.0.0.1:45803_solr] Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/15)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{       "range":"80000000-ffffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"testSimple2_shard1_replica_n1",           "base_url":"https://127.0.0.1:44045/solr",           "node_name":"127.0.0.1:44045_solr",           "state":"down",           "type":"NRT"},         "core_node5":{           "core":"testSimple2_shard1_replica_n2",           "base_url":"https://127.0.0.1:43691/solr",           "node_name":"127.0.0.1:43691_solr",           "state":"active",           "type":"NRT",           "leader":"true"}}},     "shard2":{       "range":"0-7fffffff",       "state":"active",       "replicas":{         "core_node7":{           "core":"testSimple2_shard2_replica_n4",           "base_url":"https://127.0.0.1:44045/solr",           "node_name":"127.0.0.1:44045_solr",           "state":"down",           "type":"NRT"},         "core_node8":{           "core":"testSimple2_shard2_replica_n6",           "base_url":"https://127.0.0.1:43691/solr",           "node_name":"127.0.0.1:43691_solr",           "state":"active",           "type":"NRT",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple2
null
Live Nodes: [127.0.0.1:43691_solr, 127.0.0.1:45803_solr]
Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/15)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"testSimple2_shard1_replica_n1",
          "base_url":"https://127.0.0.1:44045/solr",
          "node_name":"127.0.0.1:44045_solr",
          "state":"down",
          "type":"NRT"},
        "core_node5":{
          "core":"testSimple2_shard1_replica_n2",
          "base_url":"https://127.0.0.1:43691/solr",
          "node_name":"127.0.0.1:43691_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "core":"testSimple2_shard2_replica_n4",
          "base_url":"https://127.0.0.1:44045/solr",
          "node_name":"127.0.0.1:44045_solr",
          "state":"down",
          "type":"NRT"},
        "core_node8":{
          "core":"testSimple2_shard2_replica_n6",
          "base_url":"https://127.0.0.1:43691/solr",
          "node_name":"127.0.0.1:43691_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([34440A0E8887F38E:CF72EF0AF74275F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:126)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1837 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20180226_203134_83216440393134983996540.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20180226_203134_83213013440686828633767.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20180226_203134_8325143981632332616299.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 275 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20180226_203911_89017450935075391412741.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 23 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20180226_203911_8909164743913423732850.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20180226_203911_89017280088755627011939.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1062 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20180226_204047_87516655021982500739076.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20180226_204047_8754523903542530324077.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20180226_204047_87512667364443679848891.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 228 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20180226_204218_8836577779566263691088.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20180226_204218_88313876783160736375734.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 11 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20180226_204218_88313703138012075237655.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 251 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20180226_204231_57614589852893086708897.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20180226_204231_5769102098200492901775.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20180226_204231_5763267005178438751569.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20180226_204255_4104586153787316853941.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20180226_204255_4103279636368739045511.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20180226_204255_41012250034377684211072.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20180226_204259_08411504387677292891571.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20180226_204259_08512284535653504206576.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20180226_204259_08411154765707036531269.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 176 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20180226_204301_74911303789476974254857.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20180226_204301_7493768658820923917768.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20180226_204301_7496535970457774259839.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20180226_204311_4271287969767257500423.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20180226_204311_4278515011659344742805.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20180226_204318_2978561979612397745151.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20180226_204318_297723327956804853944.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20180226_204318_2979164806645665095173.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 177 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20180226_204320_664931173941207727659.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 158 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20180226_204329_6167054364605838167341.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20180226_204329_61611286733262014271830.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 19 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20180226_204329_6161017020308305786322.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1390 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20180226_204349_9028780161571507481423.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20180226_204349_90216349732095031633074.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20180226_204349_90212897833237323611327.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 250 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20180226_204357_4079351597849915401059.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20180226_204357_40715046814803778042438.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20180226_204357_4073403358100031527363.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 254 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20180226_204406_3812194675070992598331.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20180226_204406_3821580610195274398477.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20180226_204406_3818540890407476823178.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 236 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20180226_204625_4357318659636711800936.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20180226_204625_4354878304605067698463.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20180226_204625_4351476942776403238405.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 173 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20180226_204628_0638433544536952387934.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20180226_204628_06211375704292895138339.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20180226_204628_0621751271715895261512.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20180226_204633_9548973462643153508735.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20180226_204633_95414842058226831354179.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20180226_204633_95411014844241589478063.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 182 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20180226_204701_5936993305800085028221.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20180226_204701_59315213562016450930614.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20180226_204701_59313556542700252058577.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 252 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20180226_204712_42511474868027692153602.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20180226_204712_4253702867416521787489.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20180226_204712_4248574476303002826726.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 163 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20180226_204728_481492413400791617808.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20180226_204728_4814655178568454173821.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20180226_204728_48111597592195916240636.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20180226_204746_9867634476214880586024.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20180226_204746_986726459790255959739.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 187 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20180226_204755_66714663440951557889475.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20180226_204755_6672924022066300122932.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20180226_204755_66718043285817258157836.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 310 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20180226_204810_3566437110308984344479.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20180226_204810_356632655475624149469.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20180226_204810_3563369762963747358848.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20180226_204817_2042005298408238542262.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20180226_204817_20417473481090228498000.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Completed [27/27] on J0 in 0.44s, 21 tests
   [junit4] 
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20180226_204817_20417655785181922765329.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 212 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20180226_204824_643765834025629846401.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20180226_204824_64317710501807288175211.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20180226_204824_64317495102263867285503.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 228 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20180226_204837_14217703755372510215910.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20180226_204837_14216847942025724894548.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20180226_204837_14217696686015257517530.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 317 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20180226_204919_9562351466158238373038.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20180226_204919_9561635028737635083128.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20180226_204919_9567650090582394331.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20180226_204934_5882747480250295092838.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 184 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20180226_204936_26813660774158110773596.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20180226_204936_26810273859567794281920.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20180226_204936_26810343309296396114289.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 251 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20180226_205032_8618108617043777736238.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20180226_205032_86117222115923238086893.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20180226_205032_8615265806993378615364.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3359 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
   [junit4]   2> 2241079 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/init-core-data-001
   [junit4]   2> 2241080 WARN  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 2241080 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2241080 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2241081 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001
   [junit4]   2> 2241081 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2241081 INFO  (Thread-7646) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2241081 INFO  (Thread-7646) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2241082 ERROR (Thread-7646) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2241181 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:40133
   [junit4]   2> 2241182 INFO  (zkConnectionManagerCallback-6079-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241184 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241185 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ceecb54{/solr,null,AVAILABLE}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@38865cb1{/solr,null,AVAILABLE}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d6e2f1a{/solr,null,AVAILABLE}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36d0f5a6{/solr,null,AVAILABLE}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5441e997{HTTP/1.1,[http/1.1]}{127.0.0.1:৩৯১৯৫}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.e.j.s.Server Started @২২৪২৭৪৬ms
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39195}
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@556730a7{/solr,null,AVAILABLE}
   [junit4]   2> 2241187 ERROR (jetty-launcher-6076-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@60673255{HTTP/1.1,[http/1.1]}{127.0.0.1:৪১৯৩৯}
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.e.j.s.Server Started @২২৪২৭৪৬ms
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41939}
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2241187 ERROR (jetty-launcher-6076-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5b79371f{HTTP/1.1,[http/1.1]}{127.0.0.1:৩৪৩১৯}
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-3) [    ] o.e.j.s.Server Started @২২৪২৭৪৭ms
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.187584Z
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2651c615{/solr,null,AVAILABLE}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d5bb05b{HTTP/1.1,[http/1.1]}{127.0.0.1:৪৫৭৫৫}
   [junit4]   2> 2241186 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6ad6cfe4{HTTP/1.1,[http/1.1]}{127.0.0.1:৪১৯৪৯}
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.e.j.s.Server Started @২২৪২৭৪৭ms
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.e.j.s.Server Started @২২৪২৭৪৭ms
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45755}
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5cb64549{HTTP/1.1,[http/1.1]}{127.0.0.1:৩৭৫৩৩}
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41949}
   [junit4]   2> 2241188 ERROR (jetty-launcher-6076-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241188 ERROR (jetty-launcher-6076-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.188547Z
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34319}
   [junit4]   2> 2241187 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.188692Z
   [junit4]   2> 2241188 ERROR (jetty-launcher-6076-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.188574Z
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.188958Z
   [junit4]   2> 2241188 INFO  (jetty-launcher-6076-thread-1) [    ] o.e.j.s.Server Started @২২৪২৭৪৭ms
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37533}
   [junit4]   2> 2241189 ERROR (jetty-launcher-6076-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2241189 INFO  (zkConnectionManagerCallback-6083-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241189 INFO  (zkConnectionManagerCallback-6081-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241189 INFO  (zkConnectionManagerCallback-6085-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T21:28:58.189685Z
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241189 INFO  (zkConnectionManagerCallback-6087-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241189 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241190 INFO  (zkConnectionManagerCallback-6091-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241190 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241190 INFO  (zkConnectionManagerCallback-6089-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241191 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2241196 INFO  (jetty-launcher-6076-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241197 INFO  (jetty-launcher-6076-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241197 INFO  (zkConnectionManagerCallback-6098-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241198 INFO  (jetty-launcher-6076-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241203 INFO  (zkConnectionManagerCallback-6103-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241204 INFO  (jetty-launcher-6076-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241204 INFO  (jetty-launcher-6076-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241204 INFO  (zkConnectionManagerCallback-6105-thread-1-processing-n:127.0.0.1:41939_solr) [n:127.0.0.1:41939_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241205 INFO  (jetty-launcher-6076-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40133/solr
   [junit4]   2> 2241206 INFO  (zkConnectionManagerCallback-6116-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241210 INFO  (zkConnectionManagerCallback-6111-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241210 INFO  (zkConnectionManagerCallback-6100-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241210 INFO  (zkConnectionManagerCallback-6113-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241210 INFO  (zkConnectionManagerCallback-6119-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241215 INFO  (zkConnectionManagerCallback-6121-thread-1-processing-n:127.0.0.1:39195_solr) [n:127.0.0.1:39195_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241216 INFO  (zkConnectionManagerCallback-6124-thread-1-processing-n:127.0.0.1:34319_solr) [n:127.0.0.1:34319_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241216 INFO  (zkConnectionManagerCallback-6126-thread-1-processing-n:127.0.0.1:41949_solr) [n:127.0.0.1:41949_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241216 INFO  (zkConnectionManagerCallback-6128-thread-1-processing-n:127.0.0.1:37533_solr) [n:127.0.0.1:37533_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241219 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241220 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45755_solr
   [junit4]   2> 2241220 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241220 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241220 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241221 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.c.Overseer Overseer (id=72217744264069133-127.0.0.1:45755_solr-n_0000000000) starting
   [junit4]   2> 2241221 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241221 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39195_solr
   [junit4]   2> 2241221 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41949_solr
   [junit4]   2> 2241221 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37533_solr
   [junit4]   2> 2241226 INFO  (zkCallback-6123-thread-1-processing-n:127.0.0.1:34319_solr) [n:127.0.0.1:34319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2241227 INFO  (zkCallback-6127-thread-1-processing-n:127.0.0.1:37533_solr) [n:127.0.0.1:37533_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2241227 INFO  (zkCallback-6125-thread-1-processing-n:127.0.0.1:41949_solr) [n:127.0.0.1:41949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2241227 INFO  (zkCallback-6112-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2241227 INFO  (zkCallback-6120-thread-1-processing-n:127.0.0.1:39195_solr) [n:127.0.0.1:39195_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2241228 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34319_solr
   [junit4]   2> 2241230 INFO  (zkCallback-6127-thread-1-processing-n:127.0.0.1:37533_solr) [n:127.0.0.1:37533_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2241230 INFO  (zkCallback-6123-thread-1-processing-n:127.0.0.1:34319_solr) [n:127.0.0.1:34319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2241230 INFO  (zkCallback-6112-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2241230 INFO  (zkCallback-6125-thread-1-processing-n:127.0.0.1:41949_solr) [n:127.0.0.1:41949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2241231 INFO  (zkCallback-6120-thread-1-processing-n:127.0.0.1:39195_solr) [n:127.0.0.1:39195_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2241241 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45755_solr
   [junit4]   2> 2241246 INFO  (zkCallback-6123-thread-1-processing-n:127.0.0.1:34319_solr) [n:127.0.0.1:34319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2241246 INFO  (zkCallback-6112-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2241246 INFO  (zkCallback-6127-thread-1-processing-n:127.0.0.1:37533_solr) [n:127.0.0.1:37533_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2241246 INFO  (zkCallback-6120-thread-1-processing-n:127.0.0.1:39195_solr) [n:127.0.0.1:39195_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2241247 INFO  (zkCallback-6125-thread-1-processing-n:127.0.0.1:41949_solr) [n:127.0.0.1:41949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2241266 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39195.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241266 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34319.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241270 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37533.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241272 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 2241273 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2241273 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45755.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241274 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39195.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241274 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39195.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241275 INFO  (jetty-launcher-6076-thread-4) [n:127.0.0.1:39195_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node4/.
   [junit4]   2> 2241276 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34319.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241276 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34319.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241276 INFO  (jetty-launcher-6076-thread-3) [n:127.0.0.1:34319_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node3/.
   [junit4]   2> 2241279 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41939_solr
   [junit4]   2> 2241279 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37533.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241279 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37533.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241279 INFO  (zkCallback-6123-thread-1-processing-n:127.0.0.1:34319_solr) [n:127.0.0.1:34319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241281 INFO  (jetty-launcher-6076-thread-1) [n:127.0.0.1:37533_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node2/.
   [junit4]   2> 2241281 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41949.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241282 INFO  (zkCallback-6112-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241282 INFO  (zkCallback-6125-thread-1-processing-n:127.0.0.1:41949_solr) [n:127.0.0.1:41949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241282 INFO  (zkCallback-6127-thread-1-processing-n:127.0.0.1:37533_solr) [n:127.0.0.1:37533_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241282 INFO  (zkCallback-6120-thread-1-processing-n:127.0.0.1:39195_solr) [n:127.0.0.1:39195_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241283 INFO  (zkCallback-6104-thread-1-processing-n:127.0.0.1:41939_solr) [n:127.0.0.1:41939_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2241283 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45755.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241283 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45755.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241284 INFO  (jetty-launcher-6076-thread-5) [n:127.0.0.1:45755_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node5/.
   [junit4]   2> 2241287 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41949.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241287 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41949.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241288 INFO  (jetty-launcher-6076-thread-6) [n:127.0.0.1:41949_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node6/.
   [junit4]   2> 2241307 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41939.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241312 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41939.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241312 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41939.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40d6f752
   [junit4]   2> 2241313 INFO  (jetty-launcher-6076-thread-2) [n:127.0.0.1:41939_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001/tempDir-001/node1/.
   [junit4]   2> 2241472 INFO  (zkConnectionManagerCallback-6141-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241474 INFO  (zkConnectionManagerCallback-6145-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241474 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 2241475 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40133/solr ready
   [junit4]   2> 2241493 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[34440A0E8887F38E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 2241494 INFO  (zkConnectionManagerCallback-6147-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2241494 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[34440A0E8887F38E]) [    ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
   [junit4]   2> 2241499 INFO  (qtp1266391160-26119) [n:127.0.0.1:34319_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241500 INFO  (qtp955658275-26118) [n:127.0.0.1:37533_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241501 INFO  (qtp856696052-26130) [n:127.0.0.1:39195_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241502 INFO  (qtp1532232827-26114) [n:127.0.0.1:41939_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241503 INFO  (qtp1753901580-26123) [n:127.0.0.1:41949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241504 INFO  (qtp1113332394-26279) [n:127.0.0.1:45755_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241505 INFO  (qtp1113332394-26128) [n:127.0.0.1:45755_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 2241506 INFO  (qtp1113332394-26148) [n:127.0.0.1:45755_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2241506 INFO  (OverseerThreadFactory-8788-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
   [junit4]   2> 2241509 INFO  (qtp1266391160-26137) [n:127.0.0.1:34319_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241509 INFO  (qtp955658275-26155) [n:127.0.0.1:37533_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241510 INFO  (qtp856696052-26150) [n:127.0.0.1:39195_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241510 INFO  (qtp1532232827-26141) [n:127.0.0.1:41939_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241511 INFO  (qtp1753901580-26143) [n:127.0.0.1:41949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241511 INFO  (qtp1113332394-26156) [n:127.0.0.1:45755_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2241521 INFO  (OverseerThreadFactory-8788-thread-1-processing-n:127.0.0.1:45755_solr) [n:127.0.0.1:45755_solr    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2443698958 sessionWrapper.createTime 2443698949598285, this.sessionWrapper.createTime 2443698949598285 
   [junit4]   2> 2241626 INFO  (OverseerStateUpdate-72217744264069133-127.0.0.1:45755_solr-n_0000000000) [n:127.0.0.1:45755_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45755/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2241626 INFO  (OverseerStateUpdate-72217744264069133-127.0.0.1:45755_solr-n_0000000000) [n:127.0.0.1:45755_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41949/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2241627 INFO  (OverseerStateUpdate-72217744264069133-127.0.0.1:45755_solr-n_0000000000) [n:127.0.0.1:45755_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41939/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2241627 INFO  (OverseerStateUpdate-72217744264069133-127.0.0.1:45755_solr-n_0000000000) [n:127.0.0.1:45755_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:39195/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2241628 INFO  (Overse

[...truncated too long message...]

ing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard4.leader, tag=297157321
   [junit4]   2> 219763 INFO  (jetty-closer-369-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@73d6dc04{/solr,null,UNAVAILABLE}
   [junit4]   2> 219763 INFO  (jetty-closer-369-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 219765 INFO  (coreCloseExecutor-705-thread-1) [n:127.0.0.1:41673_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard5.leader, tag=331970815
   [junit4]   2> 219765 INFO  (coreCloseExecutor-705-thread-2) [n:127.0.0.1:41673_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard2.leader, tag=1646984758
   [junit4]   2> 219765 INFO  (coreCloseExecutor-708-thread-1) [n:127.0.0.1:44587_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard1.leader, tag=467858450
   [junit4]   2> 219767 INFO  (coreCloseExecutor-707-thread-2) [n:127.0.0.1:44367_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard2.leader, tag=276198092
   [junit4]   2> 219767 INFO  (coreCloseExecutor-707-thread-1) [n:127.0.0.1:44367_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard5.leader, tag=100091375
   [junit4]   2> 219768 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10091c8287a0010, likely client has closed socket
   [junit4]   2> 219769 INFO  (jetty-closer-369-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@53a871ee{/solr,null,UNAVAILABLE}
   [junit4]   2> 219769 INFO  (jetty-closer-369-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 219769 INFO  (jetty-closer-369-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e37c2f5{/solr,null,UNAVAILABLE}
   [junit4]   2> 219769 INFO  (jetty-closer-369-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 219769 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10091c8287a000f, likely client has closed socket
   [junit4]   2> 219769 INFO  (zkCallback-418-thread-1-processing-n:127.0.0.1:44367_solr) [n:127.0.0.1:44367_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44367_solr
   [junit4]   2> 219769 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10091c8287a0012, likely client has closed socket
   [junit4]   2> 219770 INFO  (jetty-closer-369-thread-6) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5def030a{/solr,null,UNAVAILABLE}
   [junit4]   2> 219770 INFO  (jetty-closer-369-thread-6) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 219770 ERROR (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 219770 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[34440A0E8887F38E]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37309 37309
   [junit4]   2> 224817 INFO  (Thread-376) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37309 37309
   [junit4]   2> 224818 WARN  (Thread-376) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/replacenodetest_coll_notarget/terms/shard4
   [junit4]   2> 	9	/solr/collections/replacenodetest_coll_notarget/terms/shard3
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/conf1
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard2
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard1
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard5
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	76	/solr/collections/replacenodetest_coll_notarget/state.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/collections/replacenodetest_coll_notarget/leader_elect/shard4/election/72217882896498697-core_node15-n_0000000000
   [junit4]   2> 	2	/solr/collections/replacenodetest_coll_notarget/leader_elect/shard3/election/72217882896498697-core_node13-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/72217882896498703-127.0.0.1:44587_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_34440A0E8887F38E-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=119, maxMBSortInHeap=5.285996836735492, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@759c073c), locale=sah-RU, timezone=US/Pacific-New
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=216656160,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest, AutoAddReplicasIntegrationTest, ReplaceNodeNoTargetTest, ReplaceNodeNoTargetTest]
   [junit4] Completed [8/10 (1!)] on J2 in 12.88s, 1 test, 1 failure <<< FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J2-20180226_220039_90411334116296373561640.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20180226_220039_904837978182161611382.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20180226_220039_90410968827991018751042.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 10 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 10 tests, 1 failure [seed: 34440A0E8887F38E]

Total time: 4 minutes 29 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
[repro]   1/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=50c17b92bd2709ac9432dab72dc87f3873603dbc, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21539
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21539 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21539/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseG1GC

9 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MoveReplicaHDFSFailoverTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.cloud.MoveReplicaHDFSFailoverTest.setupClass(MoveReplicaHDFSFailoverTest.java:55)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:67)
	at org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.beforeClass(HdfsRecoverLeaseTest.java:50)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.setupClass(HdfsRecoveryZkTest.java:41)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsThreadLeakTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsThreadLeakTest.beforeClass(HdfsThreadLeakTest.java:45)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.HdfsDirectoryFactoryTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:67)
	at org.apache.solr.core.HdfsDirectoryFactoryTest.setupClass(HdfsDirectoryFactoryTest.java:59)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.store.hdfs.HdfsDirectoryTest

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.store.hdfs.HdfsDirectoryTest.beforeClass(HdfsDirectoryTest.java:60)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.update.TestHdfsUpdateLog

Error Message:
Timed out waiting for Mini HDFS Cluster to start

Stack Trace:
java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
	at org.apache.solr.update.TestHdfsUpdateLog.beforeClass(TestHdfsUpdateLog.java:52)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSearchRate

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E:9DF92E7A3304F631]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testSearchRate(TriggerIntegrationTest.java:1452)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:42401_solr wasn't created

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:42401_solr wasn't created
	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E:D80BB8FFF2F79D91]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:951)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12188 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsThreadLeakTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/init-core-data-001
   [junit4]   2> 62157 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 62157 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 62157 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 62724 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 63210 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 63327 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 63343 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 63485 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 63515 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_45993_hdfs____ple4zw/webapp
   [junit4]   2> 63668 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45993
   [junit4]   2> 64150 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 64153 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 64159 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34705_datanode____.yta3vi/webapp
   [junit4]   2> 64241 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34705
   [junit4]   2> 64258 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] i.n.u.i.PlatformDependent Your platform does not provide complete low-level API for accessing direct buffers reliably. Unless explicitly requested, heap buffer will always be preferred to avoid potential system unstability.
   [junit4]   2> 64638 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 64640 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 64648 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41053_datanode____jd56e0/webapp
   [junit4]   2> 64719 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41053
   [junit4]   2> 64797 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:46755) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:46755
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-109574012-2a01:4f8:10b:2ab:0:0:0:2-1519656982677.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-109574012-2a01:4f8:10b:2ab:0:0:0:2-1519656982677.crc
   [junit4]   2> 	at java.base/java.net.URI.checkPath(URI.java:1941)
   [junit4]   2> 	at java.base/java.net.URI.<init>(URI.java:757)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 64798 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:46755) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:46755
   [junit4]   2> 64883 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:46755) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:46755
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-109574012-2a01:4f8:10b:2ab:0:0:0:2-1519656982677.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-109574012-2a01:4f8:10b:2ab:0:0:0:2-1519656982677.crc
   [junit4]   2> 	at java.base/java.net.URI.checkPath(URI.java:1941)
   [junit4]   2> 	at java.base/java.net.URI.<init>(URI.java:757)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 64884 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsThreadLeakTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:46755) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:46755
   [junit4]   2> 65086 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster BPOfferService in datanode DataNode{data=null, localName='127.0.0.1:33981', datanodeUuid='null', xmitsInProgress=0} failed to connect to namenode at localhost.localdomain/127.0.0.1:46755
   [junit4]   2> 65190 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 66191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 67191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 68191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 69191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 70191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 71191 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 72192 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 73192 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 74192 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 75192 WARN  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 76192 ERROR (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Timed out waiting for Mini HDFS Cluster to start
   [junit4]   2> 76221 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 76339 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 76450 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 76562 INFO  (SUITE-HdfsThreadLeakTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 26, 2018 2:56:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 64 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1392, maxMBSortInHeap=7.122713513038346, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5636e757), locale=lu, timezone=Pacific/Midway
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=2,free=139316720,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [UUIDUpdateProcessorFallbackTest, TestRuleBasedAuthorizationPlugin, DistribCursorPagingTest, TestBadConfig, PKIAuthenticationIntegrationTest, TestJavabinTupleStreamParser, HdfsThreadLeakTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsThreadLeakTest -Dtests.seed=C0B130F3FCC2507E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lu -Dtests.timezone=Pacific/Midway -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | HdfsThreadLeakTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsThreadLeakTest.beforeClass(HdfsThreadLeakTest.java:45)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [29/778 (1!)] on J2 in 17.22s, 0 tests, 1 error <<< FAILURES!

[...truncated 74 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/init-core-data-001
   [junit4]   2> 217007 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 217007 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 217008 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 217008 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 217009 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-001
   [junit4]   2> 217009 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 217009 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 217009 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 217010 ERROR (Thread-505) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 217109 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:44195
   [junit4]   2> 217111 INFO  (zkConnectionManagerCallback-490-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217114 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 217114 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T14:27:37-07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@305291fb{/solr,null,AVAILABLE}
   [junit4]   2> 217115 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@164f9297{/solr,null,AVAILABLE}
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3a423ebf{HTTP/1.1,[http/1.1]}{127.0.0.1:43009}
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@13ee4c9c{HTTP/1.1,[http/1.1]}{127.0.0.1:44935}
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-2) [    ] o.e.j.s.Server Started @218353ms
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-1) [    ] o.e.j.s.Server Started @218353ms
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43009}
   [junit4]   2> 217116 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44935}
   [junit4]   2> 217117 ERROR (jetty-launcher-487-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 217117 ERROR (jetty-launcher-487-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T14:58:56.861286Z
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 217117 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T14:58:56.861332Z
   [junit4]   2> 217118 INFO  (zkConnectionManagerCallback-492-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217118 INFO  (zkConnectionManagerCallback-494-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217119 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 217119 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 217123 INFO  (jetty-launcher-487-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44195/solr
   [junit4]   2> 217123 INFO  (jetty-launcher-487-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44195/solr
   [junit4]   2> 217124 INFO  (zkConnectionManagerCallback-500-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217124 INFO  (zkConnectionManagerCallback-502-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217125 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1009042cde70004, likely client has closed socket
   [junit4]   2> 217126 INFO  (zkConnectionManagerCallback-506-thread-1-processing-n:127.0.0.1:43009_solr) [n:127.0.0.1:43009_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217126 INFO  (zkConnectionManagerCallback-505-thread-1-processing-n:127.0.0.1:44935_solr) [n:127.0.0.1:44935_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217158 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 217158 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 217159 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43009_solr
   [junit4]   2> 217184 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44935_solr
   [junit4]   2> 217185 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.c.Overseer Overseer (id=72216210634637317-127.0.0.1:43009_solr-n_0000000000) starting
   [junit4]   2> 217186 INFO  (zkCallback-504-thread-1-processing-n:127.0.0.1:43009_solr) [n:127.0.0.1:43009_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 217187 INFO  (zkCallback-503-thread-1-processing-n:127.0.0.1:44935_solr) [n:127.0.0.1:44935_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 217189 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43009_solr
   [junit4]   2> 217189 INFO  (zkCallback-504-thread-1-processing-n:127.0.0.1:43009_solr) [n:127.0.0.1:43009_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 217189 INFO  (zkCallback-503-thread-1-processing-n:127.0.0.1:44935_solr) [n:127.0.0.1:44935_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 217216 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44935.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217216 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43009.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217222 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44935.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217222 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43009.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217222 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44935.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217222 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43009.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70676242
   [junit4]   2> 217223 INFO  (jetty-launcher-487-thread-2) [n:127.0.0.1:43009_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-001/node2/.
   [junit4]   2> 217223 INFO  (jetty-launcher-487-thread-1) [n:127.0.0.1:44935_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-001/node1/.
   [junit4]   2> 217255 INFO  (zkConnectionManagerCallback-512-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217257 INFO  (zkConnectionManagerCallback-516-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 217258 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 217258 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44195/solr ready
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 217344 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 217349 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 217350 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 217353 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_33143_hdfs____.3y7r4m/webapp
   [junit4]   2> 217427 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:33143
   [junit4]   2> 217497 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 217499 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 217504 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_40125_datanode____.2wtyap/webapp
   [junit4]   2> 217569 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40125
   [junit4]   2> 217595 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 217595 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 217597 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_35291_datanode____.anx3ox/webapp
   [junit4]   2> 217622 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:33541) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:33541
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-385451039-2a01:4f8:10b:2ab:0:0:0:2-1519657137018.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-385451039-2a01:4f8:10b:2ab:0:0:0:2-1519657137018.crc
   [junit4]   2> 	at java.base/java.net.URI.checkPath(URI.java:1941)
   [junit4]   2> 	at java.base/java.net.URI.<init>(URI.java:757)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 217622 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:33541) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:33541
   [junit4]   2> 217662 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35291
   [junit4]   2> 217663 WARN  (1039195191@qtp-1883641358-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35291) [    ] o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is false. Rechecking.
   [junit4]   2> 217673 WARN  (1039195191@qtp-1883641358-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35291) [    ] o.a.h.h.HttpServer2 HttpServer Acceptor: isRunning is true
   [junit4]   2> 217677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster BPOfferService in datanode DataNode{data=null, localName='127.0.0.1:42127', datanodeUuid='null', xmitsInProgress=0} failed to connect to namenode at localhost.localdomain/127.0.0.1:33541
   [junit4]   2> 217677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 217716 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:33541) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:33541
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-385451039-2a01:4f8:10b:2ab:0:0:0:2-1519657137018.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:508)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140)
   [junit4]   2> 	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.makeBlockPoolDataDir(DataStorage.java:598)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadBlockPoolSliceStorage(DataStorage.java:465)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:397)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:573)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1386)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1351)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:313)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:216)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:637)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.net.URISyntaxException: Relative path in absolute URI: .BP-385451039-2a01:4f8:10b:2ab:0:0:0:2-1519657137018.crc
   [junit4]   2> 	at java.base/java.net.URI.checkPath(URI.java:1941)
   [junit4]   2> 	at java.base/java.net.URI.<init>(URI.java:757)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
   [junit4]   2> 	... 17 more
   [junit4]   2> 217717 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C0B130F3FCC2507E-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:33541) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:33541
   [junit4]   2> 218677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 219677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 220677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 221677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 222677 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 223678 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 224678 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 225678 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 226678 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 227678 WARN  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Waiting for the Mini HDFS Cluster to start...
   [junit4]   2> 228678 ERROR (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.MiniDFSCluster Timed out waiting for Mini HDFS Cluster to start
   [junit4]   2> 228682 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 228788 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 228896 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 229007 INFO  (jetty-closer-488-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@13ee4c9c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 229007 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=723456721
   [junit4]   2> 229007 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 229007 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@418096ea: rootName = solr_44935, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1f04f885
   [junit4]   2> 229007 INFO  (jetty-closer-488-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@3a423ebf{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 229008 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1779554352
   [junit4]   2> 229008 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 229008 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@179a7337: rootName = solr_43009, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@12f2f330
   [junit4]   2> 229013 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 229013 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5268a8ea: rootName = solr_44935, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@109a580d
   [junit4]   2> 229014 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 229014 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4996c48b: rootName = solr_43009, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@109a580d
   [junit4]   2> 229017 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 229018 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@310aea88: rootName = solr_44935, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@667a2b30
   [junit4]   2> 229018 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 229018 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@31d29194: rootName = solr_43009, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@667a2b30
   [junit4]   2> 229018 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44935_solr
   [junit4]   2> 229018 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43009_solr
   [junit4]   2> 229019 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 229019 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 229019 INFO  (zkCallback-503-thread-1-processing-n:127.0.0.1:44935_solr) [n:127.0.0.1:44935_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 229019 INFO  (zkCallback-504-thread-1-processing-n:127.0.0.1:43009_solr) [n:127.0.0.1:43009_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 229019 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 229019 INFO  (jetty-closer-488-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 229019 INFO  (jetty-closer-488-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72216210634637317-127.0.0.1:43009_solr-n_0000000000) closing
   [junit4]   2> 229019 INFO  (OverseerStateUpdate-72216210634637317-127.0.0.1:43009_solr-n_0000000000) [n:127.0.0.1:43009_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43009_solr
   [junit4]   2> 229019 WARN  (OverseerAutoScalingTriggerThread-72216210634637317-127.0.0.1:43009_solr-n_0000000000) [n:127.0.0.1:43009_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 229020 INFO  (jetty-closer-488-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@305291fb{/solr,null,UNAVAILABLE}
   [junit4]   2> 229020 INFO  (jetty-closer-488-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 230520 WARN  (zkCallback-503-thread-1-processing-n:127.0.0.1:44935_solr) [n:127.0.0.1:44935_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:44935_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:44935_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 230520 INFO  (jetty-closer-488-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@164f9297{/solr,null,UNAVAILABLE}
   [junit4]   2> 230521 INFO  (jetty-closer-488-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 230521 ERROR (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 230521 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44195 44195
   [junit4]   2> 230624 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44195 44195
   [junit4]   2> 230624 WARN  (Thread-505) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> 230625 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44195 44195
   [junit4]   2> 230625 INFO  (SUITE-HdfsRecoveryZkTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 26, 2018 2:59:10 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 65 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1193, maxMBSortInHeap=5.121787495406402, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@2d9e62af), locale=tk-TM, timezone=Africa/Bamako
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=164538528,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [UUIDUpdateProcessorFallbackTest, TestRuleBasedAuthorizationPlugin, DistribCursorPagingTest, TestBadConfig, PKIAuthenticationIntegrationTest, TestJavabinTupleStreamParser, HdfsThreadLeakTest, SchemaApiFailureTest, DeleteReplicaTest, SolrCloudExampleTest, TestSubQueryTransformerDistrib, TestFiltering, TestInfoStreamLogging, DistributedQueueTest, TestTriggerIntegration, LegacyCloudClusterPropTest, UniqFieldsUpdateProcessorFactoryTest, SolrShardReporterTest, SuggesterTSTTest, HttpSolrCallGetCoreTest, HdfsRecoveryZkTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsRecoveryZkTest -Dtests.seed=C0B130F3FCC2507E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tk-TM -Dtests.timezone=Africa/Bamako -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | HdfsRecoveryZkTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C0B130F3FCC2507E]:0)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:1207)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:746)
   [junit4]    > 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:616)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:105)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.setupClass(HdfsTestUtil.java:63)
   [junit4]    > 	at org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.setupClass(HdfsRecoveryZkTest.java:41)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [54/778 (2!)] on J2 in 14.90s, 0 tests, 1 error <<< FAILURES!

[...truncated 554 lines...]
   [junit4] Suite: org.apache.solr.core.HdfsDirectoryFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_C0B130F3FCC2507E-001/init-core-data-001
   [junit4]   2> 902576 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=22 numCloses=22
   [junit4]   2> 902576 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 902576 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 902577 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 902721 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 902733 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 902734 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 902739 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_43051_hdfs____6f2j0n/webapp
   [junit4]   2> 902821 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:43051
   [junit4]   2> 902876 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 902877 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 902879 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44805_datanode____ci02zo/webapp
   [junit4]   2> 902949 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44805
   [junit4]   2> 902976 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 902977 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 902981 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_38347_datanode____1mmx20/webapp
   [junit4]   2> 903005 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_C0B130F3FCC2507E-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:45009) [    ] o.a.h.h.s.d.DataNode Unexpected exception in block pool Block pool <registering> (Datanode Uuid unassigned) service to localhost.localdomain/127.0.0.1:45009
   [junit4]   2> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .BP-288852271-2a01:4f8:10b:2ab:0:0:0:2-1519657822332.crc
   [junit4]   2> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
   [junit4]   2> 	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:90)
   [junit4]   2> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:488)
   [junit4]   2> 	at org.apache.had

[...truncated too long message...]

ashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 685784 INFO  (jetty-closer-325-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3dac218e{/solr,null,UNAVAILABLE}
   [junit4]   2> 685784 INFO  (jetty-closer-325-thread-3) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 685785 WARN  (zkCallback-591-thread-2-processing-n:127.0.0.1:43595_solr) [n:127.0.0.1:43595_solr    ] o.a.s.c.ZkController Unable to read autoscaling.json
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getAutoScalingConfig(ZkStateReader.java:189)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getAutoScalingConfig(ZkStateReader.java:175)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:877)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 685786 INFO  (jetty-closer-325-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@27cfebed{/solr,null,UNAVAILABLE}
   [junit4]   2> 685786 INFO  (jetty-closer-325-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 685786 ERROR (SUITE-TriggerIntegrationTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 685786 INFO  (SUITE-TriggerIntegrationTest-seed#[C0B130F3FCC2507E]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37339 37339
   [junit4]   2> 693987 INFO  (Thread-1698) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37339 37339
   [junit4]   2> 693988 WARN  (Thread-1698) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	40	/solr/aliases.json
   [junit4]   2> 	35	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	25	/solr/security.json
   [junit4]   2> 	10	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	9	/solr/configs/conf
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	52	/solr/collections/collection1/state.json
   [junit4]   2> 	40	/solr/clusterprops.json
   [junit4]   2> 	40	/solr/clusterstate.json
   [junit4]   2> 	30	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	20	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/collection1/leader_elect/shard1/election/72216587920801842-core_node4-n_0000000000
   [junit4]   2> 	3	/solr/overseer_elect/election/72216587920801824-127.0.0.1:45871_solr-n_0000000009
   [junit4]   2> 	2	/solr/overseer_elect/election/72216587920801842-127.0.0.1:42777_solr-n_0000000015
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	392	/solr/live_nodes
   [junit4]   2> 	76	/solr/collections
   [junit4]   2> 	20	/solr/overseer/queue-work
   [junit4]   2> 	20	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	20	/solr/overseer/queue
   [junit4]   2> 	20	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_C0B130F3FCC2507E-002
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=Asserting), id=PostingsFormat(name=LuceneFixedGap), x_s=PostingsFormat(name=Direct)}, docValues:{_version_=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1068, maxMBSortInHeap=6.757482289722827, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7b0f542d), locale=lu, timezone=Pacific/Midway
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=231981024,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsRecoveryZkTest, TriggerIntegrationTest, TestHdfsUpdateLog, TriggerIntegrationTest]
   [junit4] Completed [19/40 (3!)] on J0 in 316.84s, 14 tests, 1 failure <<< FAILURES!

[...truncated 121 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 40 suites, 145 tests, 3 failures [seed: C0B130F3FCC2507E]

Total time: 14 minutes 36 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.MoveReplicaHDFSFailoverTest
[repro]   0/5 failed: org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
[repro]   0/5 failed: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
[repro]   0/5 failed: org.apache.solr.cloud.hdfs.HdfsThreadLeakTest
[repro]   0/5 failed: org.apache.solr.core.HdfsDirectoryFactoryTest
[repro]   0/5 failed: org.apache.solr.store.hdfs.HdfsDirectoryTest
[repro]   0/5 failed: org.apache.solr.update.TestHdfsUpdateLog
[repro]   3/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a2eb7f388009b9fd0bda356fdf51e52d525124d2, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21538
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21538 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21538/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([34049F329D59DDB9:BC50A0E833A5B041]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:36435_solr wasn't created

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:36435_solr wasn't created
	at __randomizedtesting.SeedInfo.seed([34049F329D59DDB9:2CBE173E936C1056]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:951)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12471 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 92651 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/init-core-data-001
   [junit4]   2> 92652 WARN  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 92662 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 92662 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 92663 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001
   [junit4]   2> 92663 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 92673 INFO  (Thread-246) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 92673 INFO  (Thread-246) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 92690 ERROR (Thread-246) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 92773 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38565
   [junit4]   2> 92775 INFO  (zkConnectionManagerCallback-154-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 92778 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 92779 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d43bedb{/solr,null,AVAILABLE}
   [junit4]   2> 92779 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3585fcd8{/solr,null,AVAILABLE}
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@423e5e96{HTTP/1.1,[http/1.1]}{127.0.0.1:33799}
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@490f2895{HTTP/1.1,[http/1.1]}{127.0.0.1:39529}
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-1) [    ] o.e.j.s.Server Started @108023ms
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.e.j.s.Server Started @108023ms
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33799}
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39529}
   [junit4]   2> 92781 ERROR (jetty-launcher-151-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 92781 ERROR (jetty-launcher-151-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:00:52.246898Z
   [junit4]   2> 92781 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 92784 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 92784 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:00:52.249655Z
   [junit4]   2> 92797 INFO  (zkConnectionManagerCallback-158-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92797 INFO  (zkConnectionManagerCallback-156-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92797 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 92797 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 92814 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008f68d6a10002, likely client has closed socket
   [junit4]   2> 92821 INFO  (jetty-launcher-151-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 92833 INFO  (jetty-launcher-151-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 92837 INFO  (zkConnectionManagerCallback-163-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92840 INFO  (zkConnectionManagerCallback-166-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92842 INFO  (zkConnectionManagerCallback-168-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92842 INFO  (zkConnectionManagerCallback-170-thread-1-processing-n:127.0.0.1:39529_solr) [n:127.0.0.1:39529_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92878 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 92878 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 92879 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39529_solr
   [junit4]   2> 92879 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33799_solr
   [junit4]   2> 92879 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.c.Overseer Overseer (id=72215274478174214-127.0.0.1:39529_solr-n_0000000000) starting
   [junit4]   2> 92880 INFO  (zkCallback-169-thread-1-processing-n:127.0.0.1:39529_solr) [n:127.0.0.1:39529_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 92880 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 92888 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 92888 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 92888 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39529_solr
   [junit4]   2> 92889 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33799_solr]
   [junit4]   2> 92889 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 92889 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 92889 INFO  (zkCallback-169-thread-1-processing-n:127.0.0.1:39529_solr) [n:127.0.0.1:39529_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 92889 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 92890 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 92890 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 92890 DEBUG (ScheduledTrigger-449-thread-1) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 92916 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39529.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92921 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39529.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92921 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39529.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92923 INFO  (jetty-launcher-151-thread-2) [n:127.0.0.1:39529_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node2/.
   [junit4]   2> 92948 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33799.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92954 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33799.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92954 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33799.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 92955 INFO  (jetty-launcher-151-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node1/.
   [junit4]   2> 92970 INFO  (zkConnectionManagerCallback-176-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92974 INFO  (zkConnectionManagerCallback-180-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92975 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 92976 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38565/solr ready
   [junit4]   2> 92982 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testListeners
   [junit4]   2> 92984 INFO  (qtp1309377313-862) [n:127.0.0.1:33799_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 92991 INFO  (qtp1309377313-862) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 92992 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 92994 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 92994 DEBUG (zkCallback-169-thread-1-processing-n:127.0.0.1:39529_solr) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 92994 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 92994 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 92994 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 92994 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 92994 DEBUG (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 92995 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@490f2895{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 92995 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2024330554
   [junit4]   2> 92996 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 92996 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61f76d03: rootName = solr_39529, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@68a14e16
   [junit4]   2> 93000 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 93000 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@74a0d458: rootName = solr_39529, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5ff822a6
   [junit4]   2> 93003 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 93003 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1826dc50: rootName = solr_39529, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3c088e7a
   [junit4]   2> 93005 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39529_solr
   [junit4]   2> 93005 INFO  (zkCallback-169-thread-1-processing-n:127.0.0.1:39529_solr) [n:127.0.0.1:39529_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 93005 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 93005 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 93006 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 93006 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.Overseer Overseer (id=72215274478174214-127.0.0.1:39529_solr-n_0000000000) closing
   [junit4]   2> 93006 INFO  (OverseerStateUpdate-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39529_solr
   [junit4]   2> 93006 WARN  (OverseerAutoScalingTriggerThread-72215274478174214-127.0.0.1:39529_solr-n_0000000000) [n:127.0.0.1:39529_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 93009 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 93009 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 93010 DEBUG (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 93010 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d43bedb{/solr,null,UNAVAILABLE}
   [junit4]   2> 93010 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33799_solr
   [junit4]   2> 93011 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 93011 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.Overseer Overseer (id=72215274478174213-127.0.0.1:33799_solr-n_0000000001) starting
   [junit4]   2> 93018 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 93018 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 93019 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33799_solr]
   [junit4]   2> 93019 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
   [junit4]   2> 93019 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 93020 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 93020 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 93020 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 94020 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 95021 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 96021 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 97021 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 98012 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 98013 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 98013 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 98013 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 98014 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e205810{/solr,null,AVAILABLE}
   [junit4]   2> 98014 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6ed415e2{HTTP/1.1,[http/1.1]}{127.0.0.1:38687}
   [junit4]   2> 98014 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server Started @113256ms
   [junit4]   2> 98014 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38687}
   [junit4]   2> 98014 ERROR (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 98015 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 98015 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 98015 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 98015 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:00:57.480249Z
   [junit4]   2> 98016 INFO  (zkConnectionManagerCallback-183-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98017 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 98021 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 98022 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 98023 INFO  (zkConnectionManagerCallback-187-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98027 INFO  (zkConnectionManagerCallback-189-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98030 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 98031 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 98032 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38687_solr
   [junit4]   2> 98033 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 98033 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 98033 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 98038 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 98072 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38687.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98080 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38687.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98080 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38687.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98081 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:38687_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node3/.
   [junit4]   2> 98113 INFO  (qtp1309377313-956) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98115 INFO  (qtp131675615-933) [n:127.0.0.1:38687_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98116 DEBUG (qtp1309377313-870) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 98117 INFO  (qtp1309377313-870) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=8
   [junit4]   2> 98117 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 98119 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98119 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerL instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}, {name=test1, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestDummyAction}], enabled=true}
   [junit4]   2> 98119 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98119 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 98120 INFO  (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 98122 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerL
   [junit4]   2> 98122 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 98123 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 98125 INFO  (qtp1309377313-872) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98128 INFO  (qtp131675615-937) [n:127.0.0.1:38687_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98128 DEBUG (qtp1309377313-874) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 98129 INFO  (qtp1309377313-874) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 98130 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 98130 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98130 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerL instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}, {name=test1, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestDummyAction}], enabled=true}
   [junit4]   2> 98131 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98131 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 98132 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 98133 INFO  (qtp1309377313-957) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98135 INFO  (qtp131675615-933) [n:127.0.0.1:38687_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 98136 DEBUG (qtp1309377313-870) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 98136 INFO  (qtp1309377313-870) [n:127.0.0.1:33799_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 98136 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 98137 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98137 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerL instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}, {name=test1, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestDummyAction}], enabled=true}
   [junit4]   2> 98137 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33799_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 98137 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 98138 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 98138 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 98165 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 98165 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 98165 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 98169 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f1c16bd{/solr,null,AVAILABLE}
   [junit4]   2> 98170 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@73749bea{HTTP/1.1,[http/1.1]}{127.0.0.1:33523}
   [junit4]   2> 98170 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server Started @113412ms
   [junit4]   2> 98170 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33523}
   [junit4]   2> 98170 ERROR (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 98170 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 98171 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 98171 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 98171 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:00:57.636093Z
   [junit4]   2> 98175 INFO  (zkConnectionManagerCallback-193-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98177 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 98186 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 98193 INFO  (zkConnectionManagerCallback-197-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98197 INFO  (zkConnectionManagerCallback-199-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 98202 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 98203 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 98205 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33523_solr
   [junit4]   2> 98206 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 98207 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 98206 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 98207 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 98207 INFO  (zkCallback-198-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 98254 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98260 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98260 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 98261 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:33523_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node4/.
   [junit4]   2> 99022 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 99124 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerL
   [junit4]   2> 99125 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 99125 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:33523_solr at time 2406019027656828
   [junit4]   2> 100023 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 100125 DEBUG (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerL
   [junit4]   2> 100125 DEBUG (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 100126 DEBUG (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerL firing registered processor for nodes: [127.0.0.1:33523_solr] added at times [2406019027656828], now=2406020028536756
   [junit4]   2> 100126 DEBUG (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"88c42f577607cT2gom9s21ih4d1mmwql74uzm5h",
   [junit4]   2>   "source":"node_added_triggerL",
   [junit4]   2>   "eventTime":2406019027656828,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406019027656828],
   [junit4]   2>     "nodeNames":["127.0.0.1:33523_solr"]}}
   [junit4]   2> 100126 DEBUG (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerL]
   [junit4]   2> 100128 INFO  (ScheduledTrigger-458-thread-4) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 100129 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"88c42f577607cT2gom9s21ih4d1mmwql74uzm5h",
   [junit4]   2>   "source":"node_added_triggerL",
   [junit4]   2>   "eventTime":2406019027656828,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406019027656828],
   [junit4]   2>     "_enqueue_time_":2406020029563288,
   [junit4]   2>     "nodeNames":["127.0.0.1:33523_solr"]}}
   [junit4]   2> 100131 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 100131 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerL after 5000ms
   [junit4]   2> 100132 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 2 ms for event id=88c42f577607cT2gom9s21ih4d1mmwql74uzm5h
   [junit4]   2> 102131 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 102133 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 102133 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 102133 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 102133 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40ecefce{/solr,null,AVAILABLE}
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@44295d9f{HTTP/1.1,[http/1.1]}{127.0.0.1:45927}
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server Started @117376ms
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45927}
   [junit4]   2> 102134 ERROR (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 102134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:01:01.599506Z
   [junit4]   2> 102136 INFO  (zkConnectionManagerCallback-203-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 102137 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 102142 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 102144 INFO  (zkConnectionManagerCallback-207-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 102146 INFO  (zkConnectionManagerCallback-209-thread-1-processing-n:127.0.0.1:45927_solr) [n:127.0.0.1:45927_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 102150 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 102151 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 102152 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45927_solr
   [junit4]   2> 102153 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102153 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102153 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102153 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102153 INFO  (zkCallback-198-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102153 INFO  (zkCallback-208-thread-1-processing-n:127.0.0.1:45927_solr) [n:127.0.0.1:45927_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 102215 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45927.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 102224 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45927.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 102224 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45927.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 102226 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [n:127.0.0.1:45927_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node5/.
   [junit4]   2> 105132 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 105132 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerL
   [junit4]   2> 105132 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 105132 DEBUG (ScheduledTrigger-458-thread-3) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:45927_solr at time 2406025034743043
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-1) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerL
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerL firing registered processor for nodes: [127.0.0.1:45927_solr] added at times [2406025034743043], now=2406026035612781
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"88c445b843d03T2gom9s21ih4d1mmwql74uzm5j",
   [junit4]   2>   "source":"node_added_triggerL",
   [junit4]   2>   "eventTime":2406025034743043,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406025034743043],
   [junit4]   2>     "nodeNames":["127.0.0.1:45927_solr"]}}
   [junit4]   2> 106133 DEBUG (ScheduledTrigger-458-thread-2) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerL]
   [junit4]   2> 106133 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"88c445b843d03T2gom9s21ih4d1mmwql74uzm5j",
   [junit4]   2>   "source":"node_added_triggerL",
   [junit4]   2>   "eventTime":2406025034743043,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406025034743043],
   [junit4]   2>     "_enqueue_time_":2406026035841234,
   [junit4]   2>     "nodeNames":["127.0.0.1:45927_solr"]}}
   [junit4]   2> 106134 WARN  (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Exception executing actions
   [junit4]   2> java.lang.Exception: Error executing action: test1 for trigger event: {
   [junit4]   2>   "id":"88c445b843d03T2gom9s21ih4d1mmwql74uzm5j",
   [junit4]   2>   "source":"node_added_triggerL",
   [junit4]   2>   "eventTime":2406025034743043,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406025034743043],
   [junit4]   2>     "_enqueue_time_":2406026035841234,
   [junit4]   2>     "nodeNames":["127.0.0.1:45927_solr"]}}
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:300)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: java.lang.RuntimeException: failure
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestDummyAction.process(TriggerIntegrationTest.java:1002)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:297)
   [junit4]   2> 	... 6 more
   [junit4]   2> 106134 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 106134 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerL after 5000ms
   [junit4]   2> 106135 DEBUG (AutoscalingActionExecutor-459-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=88c445b843d03T2gom9s21ih4d1mmwql74uzm5j
   [junit4]   2> 108134 INFO  (TEST-TriggerIntegrationTest.testListeners-seed#[34049F329D59DDB9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testListeners
   [junit4]   2> 108147 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
   [junit4]   2> 108149 INFO  (qtp1118961687-962) [n:127.0.0.1:33523_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 108154 INFO  (qtp1118961687-962) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 108154 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 108155 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_triggerL
   [junit4]   2> 108156 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 7
   [junit4]   2> 108156 DEBUG (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 108156 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 108156 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 108156 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 108157 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 108157 DEBUG (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 108158 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@423e5e96{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 108158 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1393317952
   [junit4]   2> 108158 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 108158 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c949477: rootName = solr_33799, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@62828eae
   [junit4]   2> 108165 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 108165 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@bf671ca: rootName = solr_33799, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5ff822a6
   [junit4]   2> 108169 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 108169 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4cb013b3: rootName = solr_33799, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3c088e7a
   [junit4]   2> 108170 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33799_solr
   [junit4]   2> 108171 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108171 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 108171 INFO  (zkCallback-208-thread-1-processing-n:127.0.0.1:45927_solr) [n:127.0.0.1:45927_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108171 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 108172 INFO  (zkCallback-167-thread-1-processing-n:127.0.0.1:33799_solr) [n:127.0.0.1:33799_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108172 INFO  (zkCallback-198-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108172 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.Overseer Overseer (id=72215274478174213-127.0.0.1:33799_solr-n_0000000001) closing
   [junit4]   2> 108172 INFO  (OverseerStateUpdate-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33799_solr
   [junit4]   2> 108172 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108172 WARN  (OverseerAutoScalingTriggerThread-72215274478174213-127.0.0.1:33799_solr-n_0000000001) [n:127.0.0.1:33799_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 108173 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108172 DEBUG (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 108172 INFO  (zkCallback-179-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 108174 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38687_solr
   [junit4]   2> 108174 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3585fcd8{/solr,null,UNAVAILABLE}
   [junit4]   2> 108174 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 108175 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.Overseer Overseer (id=72215274478174219-127.0.0.1:38687_solr-n_0000000002) starting
   [junit4]   2> 108177 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 108185 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
   [junit4]   2> 108186 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33523_solr, 127.0.0.1:45927_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 108186 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion -1
   [junit4]   2> 108186 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
   [junit4]   2> 108189 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 108189 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 108190 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 109190 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 110191 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 111191 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 112191 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 113181 INFO  (qtp1118961687-967) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 113183 INFO  (qtp131675615-933) [n:127.0.0.1:38687_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 113185 INFO  (qtp1016862878-987) [n:127.0.0.1:45927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 113186 DEBUG (qtp1118961687-966) [n:127.0.0.1:33523_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 113186 INFO  (qtp1118961687-966) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 113187 DEBUG (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
   [junit4]   2> 113187 DEBUG (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33523_solr, 127.0.0.1:45927_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 113187 DEBUG (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33523_solr, 127.0.0.1:45927_solr, 127.0.0.1:38687_solr]
   [junit4]   2> 113187 DEBUG (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 113187 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
   [junit4]   2> 113189 INFO  (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 113189 DEBUG (OverseerAutoScalingTriggerThread-72215274478174219-127.0.0.1:38687_solr-n_0000000002) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
   [junit4]   2> 113189 DEBUG (ScheduledTrigger-481-thread-4) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 113189 DEBUG (ScheduledTrigger-481-thread-4) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 113190 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 113191 DEBUG (ScheduledTrigger-481-thread-3) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 113192 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 113192 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 113192 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 113196 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a72c293{/solr,null,AVAILABLE}
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7315f0b8{HTTP/1.1,[http/1.1]}{127.0.0.1:46819}
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.e.j.s.Server Started @128439ms
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46819}
   [junit4]   2> 113197 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 113197 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 113198 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T11:01:12.662990Z
   [junit4]   2> 113199 INFO  (zkConnectionManagerCallback-214-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 113200 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 113205 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38565/solr
   [junit4]   2> 113207 INFO  (zkConnectionManagerCallback-218-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 113209 INFO  (zkConnectionManagerCallback-220-thread-1-processing-n:127.0.0.1:46819_solr) [n:127.0.0.1:46819_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 113213 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 113214 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 113215 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46819_solr
   [junit4]   2> 113217 INFO  (zkCallback-198-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113217 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113217 INFO  (zkCallback-208-thread-1-processing-n:127.0.0.1:45927_solr) [n:127.0.0.1:45927_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113217 INFO  (zkCallback-179-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113217 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113217 INFO  (zkCallback-188-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 113218 INFO  (zkCallback-219-thread-1-processing-n:127.0.0.1:46819_solr) [n:127.0.0.1:46819_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 114190 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 114190 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 114190 DEBUG (ScheduledTrigger-481-thread-1) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:46819_solr at time 2406034093364162
   [junit4]   2> 114191 DEBUG (ScheduledTrigger-481-thread-4) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 115191 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 115191 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 115191 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:46819_solr] added at times [2406034093364162], now=2406035094292979
   [junit4]   2> 115191 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"88c467773d3c2T2gom9s21ih4d1mmwql74uzm5k",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":2406034093364162,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406034093364162],
   [junit4]   2>     "nodeNames":["127.0.0.1:46819_solr"]}}
   [junit4]   2> 115192 DEBUG (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger]
   [junit4]   2> 115192 INFO  (ScheduledTrigger-481-thread-2) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 115193 DEBUG (AutoscalingActionExecutor-482-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"88c467773d3c2T2gom9s21ih4d1mmwql74uzm5k",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":2406034093364162,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2406034093364162],
   [junit4]   2>     "_enqueue_time_":2406035094707200,
   [junit4]   2>     "nodeNames":["127.0.0.1:46819_solr"]}}
   [junit4]   2> 115193 DEBUG (AutoscalingActionExecutor-482-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 115194 DEBUG (AutoscalingActionExecutor-482-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 5000ms
   [junit4]   2> 115194 DEBUG (AutoscalingActionExecutor-482-thread-1-processing-n:127.0.0.1:38687_solr) [n:127.0.0.1:38687_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=88c467773d3c2T2gom9s21ih4d1mmwql74uzm5k
   [junit4]   2> 118280 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46819.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 118290 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46819.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 118291 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46819.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a0c0a44
   [junit4]   2> 118292 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[34049F329D59DDB9]) [n:127.0.0.1:46819_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001/tempDir-001/node6/.
   [junit4]   2> 118378 INFO  (qtp1118961687-966) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 118382 INFO  (qtp131675615-934) [n:127.0.0.1:38687_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 118387 INFO  (qtp1016862878-993) [n:127.0.0.1:45927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime

[...truncated too long message...]

.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 553157 INFO  (jetty-closer-313-thread-5) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 553157 INFO  (zkCallback-584-thread-2-processing-n:127.0.0.1:41217_solr) [n:127.0.0.1:41217_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 553158 INFO  (jetty-closer-313-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 553158 INFO  (zkCallback-543-thread-1-processing-n:127.0.0.1:37981_solr) [n:127.0.0.1:37981_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 553158 INFO  (zkCallback-584-thread-1-processing-n:127.0.0.1:41217_solr) [n:127.0.0.1:41217_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 553159 INFO  (jetty-closer-313-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18fda3d5{/solr,null,UNAVAILABLE}
   [junit4]   2> 553159 INFO  (jetty-closer-313-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 553162 INFO  (jetty-closer-313-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72215582588928066-127.0.0.1:37981_solr-n_0000000020) closing
   [junit4]   2> 553162 INFO  (OverseerStateUpdate-72215582588928066-127.0.0.1:37981_solr-n_0000000020) [n:127.0.0.1:37981_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37981_solr
   [junit4]   2> 553162 WARN  (OverseerAutoScalingTriggerThread-72215582588928066-127.0.0.1:37981_solr-n_0000000020) [n:127.0.0.1:37981_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 553162 DEBUG (jetty-closer-313-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 553163 INFO  (jetty-closer-313-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@528d73a7{/solr,null,UNAVAILABLE}
   [junit4]   2> 553163 INFO  (jetty-closer-313-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 554659 WARN  (zkCallback-584-thread-2-processing-n:127.0.0.1:41217_solr) [n:127.0.0.1:41217_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:41217_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:41217_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 554660 INFO  (jetty-closer-313-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@24addf14{/solr,null,UNAVAILABLE}
   [junit4]   2> 554660 INFO  (jetty-closer-313-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 554661 ERROR (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 554661 INFO  (SUITE-TriggerIntegrationTest-seed#[34049F329D59DDB9]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42839 42839
   [junit4]   2> 560486 INFO  (Thread-328) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42839 42839
   [junit4]   2> 560487 WARN  (Thread-328) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/aliases.json
   [junit4]   2> 	43	/solr/clusterprops.json
   [junit4]   2> 	35	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	28	/solr/security.json
   [junit4]   2> 	11	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	9	/solr/configs/conf
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	62	/solr/collections/collection1/state.json
   [junit4]   2> 	43	/solr/clusterstate.json
   [junit4]   2> 	32	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	20	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/collection1/leader_elect/shard1/election/72215582588928081-core_node3-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/72215582588928066-127.0.0.1:37981_solr-n_0000000020
   [junit4]   2> 	2	/solr/overseer_elect/election/72215582588928081-127.0.0.1:35053_solr-n_0000000025
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	417	/solr/live_nodes
   [junit4]   2> 	81	/solr/collections
   [junit4]   2> 	20	/solr/overseer/queue-work
   [junit4]   2> 	20	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	20	/solr/overseer/queue
   [junit4]   2> 	20	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_34049F329D59DDB9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=Lucene50(blocksize=128), x_s=FSTOrd50}, docValues:{}, maxPointsInLeafNode=1328, maxMBSortInHeap=5.9256879725597535, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@29508cc8), locale=nb-SJ, timezone=Etc/GMT+5
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=417247528,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TriggerIntegrationTest]
   [junit4] Completed [10/10 (4!)] on J0 in 279.48s, 14 tests, 1 failure <<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 75 tests, 4 failures [seed: 34049F329D59DDB9]

Total time: 9 minutes 24 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   2/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro]   2/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=86be87391511b3636ea952d40343305762d4f63c, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21537
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 21537 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21537/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([E0760FE6D71E4DD9:8D8AAB1B6D56B2DE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:313)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 14187 lines...]
   [junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/init-core-data-001
   [junit4]   2> 2531466 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2531466 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2531467 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2531467 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001
   [junit4]   2> 2531467 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2531467 INFO  (Thread-8536) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2531467 INFO  (Thread-8536) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2531468 ERROR (Thread-8536) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2531567 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39163
   [junit4]   2> 2531569 INFO  (zkConnectionManagerCallback-4843-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531571 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2531571 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f2e7290{/solr,null,AVAILABLE}
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d7975be{/solr,null,AVAILABLE}
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7d80ceb1{SSL,[ssl, http/1.1]}{127.0.0.1:39041}
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@790786bb{SSL,[ssl, http/1.1]}{127.0.0.1:34873}
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.e.j.s.Server Started @2533019ms
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.e.j.s.Server Started @2533019ms
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39041}
   [junit4]   2> 2531572 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34873}
   [junit4]   2> 2531573 ERROR (jetty-launcher-4840-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2531573 ERROR (jetty-launcher-4840-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T08:34:47.694371Z
   [junit4]   2> 2531573 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T08:34:47.694398Z
   [junit4]   2> 2531574 INFO  (zkConnectionManagerCallback-4847-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531574 INFO  (zkConnectionManagerCallback-4846-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531574 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2531574 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2531576 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008ee31a1a0001, likely client has closed socket
   [junit4]   2> 2531577 INFO  (jetty-launcher-4840-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39163/solr
   [junit4]   2> 2531577 INFO  (jetty-launcher-4840-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39163/solr
   [junit4]   2> 2531578 INFO  (zkConnectionManagerCallback-4853-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531578 INFO  (zkConnectionManagerCallback-4855-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531578 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008ee31a1a0003, likely client has closed socket
   [junit4]   2> 2531579 INFO  (zkConnectionManagerCallback-4857-thread-1-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531579 INFO  (zkConnectionManagerCallback-4859-thread-1-processing-n:127.0.0.1:39041_solr) [n:127.0.0.1:39041_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531606 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2531606 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2531606 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34873_solr
   [junit4]   2> 2531606 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39041_solr
   [junit4]   2> 2531606 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer Overseer (id=72214700084559877-127.0.0.1:34873_solr-n_0000000000) starting
   [junit4]   2> 2531609 INFO  (zkCallback-4856-thread-1-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2531610 INFO  (zkCallback-4858-thread-1-processing-n:127.0.0.1:39041_solr) [n:127.0.0.1:39041_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2531614 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2531614 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 2531614 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 2531614 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34873_solr
   [junit4]   2> 2531615 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:34873_solr"} current state version: 0
   [junit4]   2> 2531615 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:39041_solr]
   [junit4]   2> 2531615 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:34873_solr
   [junit4]   2> 2531615 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 2531615 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 2531617 INFO  (zkCallback-4856-thread-1-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2531618 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2531618 DEBUG (OverseerAutoScalingTriggerThread-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 2531618 DEBUG (ScheduledTrigger-8496-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 2531620 INFO  (zkCallback-4858-thread-1-processing-n:127.0.0.1:39041_solr) [n:127.0.0.1:39041_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2531638 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34873.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531640 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39041.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531643 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34873.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531643 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34873.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531644 INFO  (jetty-launcher-4840-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node1/.
   [junit4]   2> 2531647 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39041.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531647 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39041.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2531648 INFO  (jetty-launcher-4840-thread-2) [n:127.0.0.1:39041_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/.
   [junit4]   2> 2531673 INFO  (zkConnectionManagerCallback-4865-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531675 INFO  (zkConnectionManagerCallback-4869-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2531676 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2531677 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39163/solr ready
   [junit4]   2> 2531687 INFO  (qtp265991781-27105) [n:127.0.0.1:34873_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34873_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2531691 INFO  (OverseerThreadFactory-8498-thread-1-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 2531692 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "name":".system",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "numShards":1,
   [junit4]   2>   "createNodeSet":"127.0.0.1:34873_solr",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 2531692 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 2531693 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/.system/state.json
   [junit4]   2> 2531794 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2531794 INFO  (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2531795 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 2531795 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2531895 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 0
   [junit4]   2> 2531997 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2531998 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2532006 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2532006 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2532006 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:34873/solr","node_name":"127.0.0.1:34873_solr","state":"down","type":"NRT"}
   [junit4]   2> 2532006 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>           "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2532107 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 1
   [junit4]   2> 2532107 INFO  (zkCallback-4856-thread-1-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2532107 INFO  (zkCallback-4856-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2532618 DEBUG (ScheduledTrigger-8496-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 2533011 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2533013 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 2533014 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 2533016 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2533016 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 2533017 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 2533017 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 2533018 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34873.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71be9b2c
   [junit4]   2> 2533018 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2533018 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node1/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
   [junit4]   2> 2533048 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2533048 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2533049 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs 
   [junit4]   2> 2533049 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2533050 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3be5f82b[.system_shard1_replica_n1] main]
   [junit4]   2> 2533051 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 2533051 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 2533051 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 2533051 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2533052 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2533052 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593451834688667648
   [junit4]   2> 2533052 INFO  (searcherExecutor-8503-thread-1-processing-n:127.0.0.1:34873_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node2) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@3be5f82b[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34873/solr/.system_shard1_replica_n1/
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:34873/solr/.system_shard1_replica_n1/ has no replicas
   [junit4]   2> 2533056 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2533057 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34873/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 2533057 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 2533158 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 2
   [junit4]   2> 2533158 INFO  (zkCallback-4856-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2533158 INFO  (zkCallback-4856-thread-3-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2533207 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2533209 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2533209 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>   "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2533209 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":".system_shard1_replica_n1","base_url":"https://127.0.0.1:34873/solr","node_name":"127.0.0.1:34873_solr","state":"active","type":"NRT","leader":"true"}
   [junit4]   2> 2533209 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(.system//collections/.system/state.json/3)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:34873/solr",
   [junit4]   2>           "node_name":"127.0.0.1:34873_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true"}}}}}
   [junit4]   2> 2533237 INFO  (qtp265991781-27107) [n:127.0.0.1:34873_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1239
   [junit4]   2> 2533239 INFO  (qtp265991781-27105) [n:127.0.0.1:34873_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2533309 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/.system/state.json version: 3
   [junit4]   2> 2533310 INFO  (zkCallback-4856-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2533310 INFO  (zkCallback-4856-thread-3-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2533619 DEBUG (ScheduledTrigger-8496-thread-2) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 2533692 INFO  (OverseerCollectionConfigSetProcessor-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2534239 INFO  (qtp265991781-27105) [n:127.0.0.1:34873_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&name=.system&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34873_solr&wt=javabin&version=2} status=0 QTime=2552
   [junit4]   2> 2534240 INFO  (qtp265991781-27109) [n:127.0.0.1:34873_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&maxShardsPerNode=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=127.0.0.1:39041_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2534242 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 2534242 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/protwords.txt
   [junit4]   2> 2534243 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 2534244 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/solrconfig.xml
   [junit4]   2> 2534244 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/synonyms.txt
   [junit4]   2> 2534245 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/stopwords.txt
   [junit4]   2> 2534245 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 2534246 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 2534246 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 2534247 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 2534247 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 2534248 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 2534249 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 2534249 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 2534250 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 2534250 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 2534251 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 2534251 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 2534252 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 2534252 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 2534253 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 2534253 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 2534254 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 2534254 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 2534255 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 2534255 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 2534256 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 2534256 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 2534257 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 2534258 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 2534258 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 2534259 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 2534259 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 2534259 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 2534260 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 2534260 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 2534261 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 2534261 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 2534262 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 2534262 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 2534263 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 2534263 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 2534264 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 2534264 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 2534265 INFO  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/params.json
   [junit4]   2> 2534265 WARN  (OverseerThreadFactory-8498-thread-2-processing-n:127.0.0.1:34873_solr) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 3 on collection AutoscalingHistoryHandlerTest_collection is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 2534267 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "createNodeSet":"127.0.0.1:39041_solr",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 2534267 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
   [junit4]   2> 2534368 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 2534470 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2534470 INFO  (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2534470 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 2534470 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2534470 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2534471 INFO  (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2534471 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2534471 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2534471 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2534471 INFO  (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2534471 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2534471 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node3":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>       "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":null,
   [junit4]   2>       "type":"NRT"}}}
   [junit4]   2> 2534572 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
   [junit4]   2> 2534619 DEBUG (ScheduledTrigger-8496-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 2534686 INFO  (qtp1565238936-27100) [n:127.0.0.1:39041_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2534686 INFO  (qtp1565238936-27104) [n:127.0.0.1:39041_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2534687 INFO  (qtp1565238936-27104) [n:127.0.0.1:39041_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2534688 INFO  (qtp1565238936-27172) [n:127.0.0.1:39041_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection.AUTOCREATED&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n4&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2534689 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2534689 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:39041/solr","node_name":"127.0.0.1:39041_solr","state":"down","type":"NRT"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4","base_url":"https://127.0.0.1:39041/solr","node_name":"127.0.0.1:39041_solr","state":"down","type":"NRT"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "node_name":null,
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"AutoscalingHistoryHandlerTest_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:39041/solr","node_name":"127.0.0.1:39041_solr","state":"down","type":"NRT"}
   [junit4]   2> 2534690 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"3",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"},
   [junit4]   2>         "core_node6":{
   [junit4]   2>           "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n4",
   [junit4]   2>           "base_url":"https://127.0.0.1:39041/solr",
   [junit4]   2>           "node_name":"127.0.0.1:39041_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 2534791 DEBUG (OverseerStateUpdate-72214700084559877-127.0.0.1:34873_solr-n_0000000000) [n:127.0.0.1:34873_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
   [junit4]   2> 2534791 INFO  (zkCallback-4858-thread-1-processing-n:127.0.0.1:39041_solr) [n:127.0.0.1:39041_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2534791 INFO  (zkCallback-4858-thread-2-processing-n:127.0.0.1:39041_solr) [n:127.0.0.1:39041_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2535619 DEBUG (ScheduledTrigger-8496-thread-1) [n:127.0.0.1:34873_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 2535693 INFO  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2535693 INFO  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2535693 INFO  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2535693 INFO  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2535693 INFO  (qtp1565238936-27100) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2535693 INFO  (qtp1565238936-27100) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2535693 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
   [junit4]   2> 2535693 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2535693 WARN  (qtp1565238936-27100) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 2535694 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
   [junit4]   2> 2535693 WARN  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/extraction/lib
   [junit4]   2> 2535694 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2535694 WARN  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2535694 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
   [junit4]   2> 2535694 WARN  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../contrib/clustering/lib
   [junit4]   2> 2535694 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
   [junit4]   2> 2535694 WARN  (qtp1565238936-27172) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001/tempDir-001/node2/AutoscalingHistoryHandlerTest_collection_shard1_replica_n4/../../../../dist
   [junit4]   2> 2535694 WARN  (qtp1565238936-27104) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.

[...truncated too long message...]

ection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=785449256
   [junit4]   2> 2549063 INFO  (coreCloseExecutor-8529-thread-2) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node6 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=904366919
   [junit4]   2> 2549063 INFO  (coreCloseExecutor-8529-thread-3) [n:127.0.0.1:39041_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=1297832031
   [junit4]   2> 2549070 INFO  (jetty-closer-4841-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2f2e7290{/solr,null,UNAVAILABLE}
   [junit4]   2> 2549070 INFO  (jetty-closer-4841-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 2549071 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2549071 INFO  (SUITE-AutoscalingHistoryHandlerTest-seed#[E0760FE6D71E4DD9]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39163 39163
   [junit4]   2> 2549181 INFO  (Thread-8536) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39163 39163
   [junit4]   2> 2549182 WARN  (Thread-8536) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/aliases.json
   [junit4]   2> 	4	/solr/collections/AutoscalingHistoryHandlerTest_collection/terms/shard1
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/AutoscalingHistoryHandlerTest_collection.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/collections/.system/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/clusterstate.json
   [junit4]   2> 	11	/solr/clusterprops.json
   [junit4]   2> 	8	/solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
   [junit4]   2> 	6	/solr/collections/.system/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/live_nodes
   [junit4]   2> 	11	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_E0760FE6D71E4DD9-001
   [junit4]   2> Feb 26, 2018 8:35:05 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {action_s=PostingsFormat(name=Memory), event.source_s=PostingsFormat(name=LuceneVarGapFixedInterval), type=Lucene50(blocksize=128), before.actions_ss=FSTOrd50, event.property._enqueue_time__ss=PostingsFormat(name=Memory), after.actions_ss=PostingsFormat(name=Memory), stage_s=PostingsFormat(name=Memory), event.id_s=PostingsFormat(name=LuceneVarGapFixedInterval), event.property.eventTimes_ss=Lucene50(blocksize=128), source_s=PostingsFormat(name=LuceneVarGapFixedInterval), event.type_s=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneVarGapFixedInterval), event.property.nodeNames_ss=Lucene50(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Memory), event.time_l=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1197, maxMBSortInHeap=7.937067867858812, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@2efb6d4b), locale=zh, timezone=Atlantic/Azores
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=122450848,total=519045120
   [junit4]   2> NOTE: All tests run in this JVM: [BlockDirectoryTest, TestPullReplicaErrorHandling, ZkNodePropsTest, TestDFISimilarityFactory, CursorPagingTest, ActionThrottleTest, RAMDirectoryFactoryTest, TestCollationField, TestDocSet, SolrGraphiteReporterTest, TestReplicaProperties, SearchRateTriggerTest, TestSubQueryTransformer, TestComplexPhraseQParserPlugin, SolrCoreCheckLockOnStartupTest, TestEmbeddedSolrServerSchemaAPI, DebugComponentTest, StressHdfsTest, TestWordDelimiterFilterFactory, ShardSplitTest, CoreAdminCreateDiscoverTest, MigrateRouteKeyTest, TestRandomFaceting, SuggestComponentContextFilterQueryTest, TestIBSimilarityFactory, SpellingQueryConverterTest, TestOnReconnectListenerSupport, HLLUtilTest, TestReRankQParserPlugin, TestWriterPerf, TestDistribDocBasedVersion, UUIDFieldTest, TestIntervalFaceting, RegexBytesRefFilterTest, TestHighlightDedupGrouping, DeleteShardTest, OutputWriterTest, TestCloudPseudoReturnFields, TestTolerantUpdateProcessorRandomCloud, InfoHandlerTest, TestHdfsBackupRestoreCore, DefaultValueUpdateProcessorTest, TestSolrCloudWithSecureImpersonation, TestPHPSerializedResponseWriter, TestSolr4Spatial2, TestPhraseSuggestions, SecurityConfHandlerTest, TestIndexingPerformance, RulesTest, CollectionTooManyReplicasTest, TestApiFramework, TestAuthorizationFramework, DistributedSuggestComponentTest, ReplaceNodeTest, WrapperMergePolicyFactoryTest, DistributedFacetPivotLongTailTest, TestMacros, SolrXmlInZkTest, TestClusterProperties, HdfsNNFailoverTest, TestFastOutputStream, UpdateParamsTest, OpenExchangeRatesOrgProviderTest, TestTestInjection, HdfsBasicDistributedZkTest, TestManagedSynonymFilterFactory, SolrIndexConfigTest, RecoveryAfterSoftCommitTest, TestJsonFacetRefinement, TermVectorComponentDistributedTest, TestCollectionsAPIViaSolrCloudCluster, HdfsTlogReplayBufferedWhileIndexingTest, DirectoryFactoryTest, TestInitParams, TestOrdValues, TestCrossCoreJoin, TestFieldCacheReopen, ChaosMonkeySafeLeaderWithPullReplicasTest, TestDynamicFieldResource, TestRestoreCore, ShardRoutingTest, TestGroupingSearch, TestSegmentSorting, AddBlockUpdateTest, SuggesterWFSTTest, AtomicUpdatesTest, ExecutePlanActionTest, CdcrVersionReplicationTest, TestStandardQParsers, TestLegacyFieldReuse, BasicAuthIntegrationTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, RequestHandlersTest, TestUseDocValuesAsStored2, TestJoin, SolrPluginUtilsTest, TestAnalyzeInfixSuggestions, TestCloudInspectUtil, MoveReplicaHDFSTest, FullSolrCloudDistribCmdsTest, MetricTriggerTest, TestAddFieldRealTimeGet, TestCSVResponseWriter, TestLuceneMatchVersion, TestConfig, ExternalFileFieldSortTest, OverseerStatusTest, TestCoreAdminApis, TestDynamicLoading, TestBlobHandler, BooleanFieldTest, ConcurrentCreateRoutedAliasTest, BinaryUpdateRequestHandlerTest, ZkCLITest, TestSerializedLuceneMatchVersion, TestComponentsName, SharedFSAutoReplicaFailoverTest, TestRetrieveFieldsOptimizer, TestPseudoReturnFields, TestInPlaceUpdatesDistrib, BadIndexSchemaTest, SolrMetricReporterTest, TestHalfAndHalfDocValues, TestSolrCloudWithHadoopAuthPlugin, RequestLoggingTest, SolrRequestParserTest, DeleteLastCustomShardedReplicaTest, TestLuceneIndexBackCompat, AssignBackwardCompatibilityTest, DeleteInactiveReplicaTest, DeleteNodeTest, DistribCursorPagingTest, DistribJoinFromCollectionTest, HealthCheckHandlerTest, HttpPartitionOnCommitTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, NodeMutatorTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerRolesTest, PeerSyncReplicationTest, TestLeaderInitiatedRecoveryThread, TestPullReplica, TriLevelCompositeIdRoutingTest, AssignTest, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, TestLocalFSCloudBackupRestore, ComputePlanActionTest, TestComputePlanAction, TestDistribStateManager, TestLargeCluster, TestPolicyCloud, BaseCdcrDistributedZkTest, CdcrBidirectionalTest, CdcrReplicationDistributedZkTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, HdfsBasicDistributedZk2Test, HdfsChaosMonkeyNothingIsSafeTest, HdfsChaosMonkeySafeLeaderTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, ZkStateWriterTest, TestDirectoryFactory, TestNRTOpen, TestReloadAndDeleteDocs, TestShardHandlerFactory, TestSimpleTextCodec, TestSolrConfigHandler, TestSolrXml, TestSolrCloudSnapshots, TestCoreBackup, TestReqParamsAPI, TestSolrConfigHandlerCloud, TestSystemCollAutoCreate, V2StandaloneTest, AutoscalingHistoryHandlerTest]
   [junit4] Completed [630/778 (1!)] on J0 in 18.23s, 1 test, 1 failure <<< FAILURES!

[...truncated 41647 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21537/consoleText

[repro] Revision: 6164643882f6f2bf371e53376cc9f0a2a184b150

[repro] Repro line:  ant test  -Dtestcase=AutoscalingHistoryHandlerTest -Dtests.method=testHistory -Dtests.seed=E0760FE6D71E4DD9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=Atlantic/Azores -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       AutoscalingHistoryHandlerTest
[repro] ant compile-test

[...truncated 3297 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.AutoscalingHistoryHandlerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=E0760FE6D71E4DD9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=Atlantic/Azores -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 76 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21536 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21536/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([C339A0248F07D90B:4B6D9FFE21FBB4F3]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12163 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/init-core-data-001
   [junit4]   2> 94957 WARN  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 94958 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 94958 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 94959 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 94960 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001
   [junit4]   2> 94960 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 94960 INFO  (Thread-109) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 94960 INFO  (Thread-109) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 94962 ERROR (Thread-109) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 95061 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38369
   [junit4]   2> 95065 INFO  (zkConnectionManagerCallback-98-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95078 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95078 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95081 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95083 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95083 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95083 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95100 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 95101 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95101 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95101 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 95105 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@85dc{/solr,null,AVAILABLE}
   [junit4]   2> 95107 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35d2fdbd{/solr,null,AVAILABLE}
   [junit4]   2> 95107 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95108 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95108 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 95112 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@770fd608{/solr,null,AVAILABLE}
   [junit4]   2> 95112 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@60a2d957{/solr,null,AVAILABLE}
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5e8614cf{SSL,[ssl, http/1.1]}{127.0.0.1:39025}
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.e.j.s.Server Started @96742ms
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39025}
   [junit4]   2> 95113 ERROR (jetty-launcher-95-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95113 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.655Z
   [junit4]   2> 95116 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95116 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95116 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bdad9b7{/solr,null,AVAILABLE}
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7e2a827e{SSL,[ssl, http/1.1]}{127.0.0.1:33523}
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@222cf686{SSL,[ssl, http/1.1]}{127.0.0.1:40557}
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-5) [    ] o.e.j.s.Server Started @96749ms
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-6) [    ] o.e.j.s.Server Started @96749ms
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40557}
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33523}
   [junit4]   2> 95120 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 95121 ERROR (jetty-launcher-95-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95121 ERROR (jetty-launcher-95-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.663Z
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.663Z
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@340aeeef{SSL,[ssl, http/1.1]}{127.0.0.1:38319}
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.e.j.s.Server Started @96750ms
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38319}
   [junit4]   2> 95121 ERROR (jetty-launcher-95-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95121 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.663Z
   [junit4]   2> 95125 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3459c9e2{/solr,null,AVAILABLE}
   [junit4]   2> 95129 INFO  (zkConnectionManagerCallback-100-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@61d5a5d5{SSL,[ssl, http/1.1]}{127.0.0.1:40701}
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.e.j.s.Server Started @96758ms
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40701}
   [junit4]   2> 95129 ERROR (jetty-launcher-95-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95129 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.671Z
   [junit4]   2> 95136 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95144 INFO  (zkConnectionManagerCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95144 INFO  (zkConnectionManagerCallback-106-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95145 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1d39d479{SSL,[ssl, http/1.1]}{127.0.0.1:33255}
   [junit4]   2> 95145 INFO  (jetty-launcher-95-thread-1) [    ] o.e.j.s.Server Started @96774ms
   [junit4]   2> 95145 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33255}
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95146 ERROR (jetty-launcher-95-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 95146 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T03:53:15.688Z
   [junit4]   2> 95150 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de159650003, likely client has closed socket
   [junit4]   2> 95153 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de159650001, likely client has closed socket
   [junit4]   2> 95154 INFO  (zkConnectionManagerCallback-102-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95154 INFO  (zkConnectionManagerCallback-108-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95154 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95160 INFO  (zkConnectionManagerCallback-110-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95161 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95161 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 95162 INFO  (jetty-launcher-95-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95164 INFO  (jetty-launcher-95-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95167 INFO  (jetty-launcher-95-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95167 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de159650006, likely client has closed socket
   [junit4]   2> 95167 INFO  (jetty-launcher-95-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95169 INFO  (jetty-launcher-95-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95169 INFO  (jetty-launcher-95-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38369/solr
   [junit4]   2> 95184 INFO  (zkConnectionManagerCallback-128-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95184 INFO  (zkConnectionManagerCallback-126-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95188 INFO  (zkConnectionManagerCallback-134-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95191 INFO  (zkConnectionManagerCallback-130-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95192 INFO  (zkConnectionManagerCallback-133-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95192 INFO  (zkConnectionManagerCallback-132-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95194 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de15965000b, likely client has closed socket
   [junit4]   2> 95194 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de15965000c, likely client has closed socket
   [junit4]   2> 95194 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008de159650007, likely client has closed socket
   [junit4]   2> 95213 INFO  (zkConnectionManagerCallback-141-thread-1-processing-n:127.0.0.1:40557_solr) [n:127.0.0.1:40557_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95216 INFO  (zkConnectionManagerCallback-138-thread-1-processing-n:127.0.0.1:40701_solr) [n:127.0.0.1:40701_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95219 INFO  (zkConnectionManagerCallback-143-thread-1-processing-n:127.0.0.1:38319_solr) [n:127.0.0.1:38319_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95219 INFO  (zkConnectionManagerCallback-137-thread-1-processing-n:127.0.0.1:33255_solr) [n:127.0.0.1:33255_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95220 INFO  (zkConnectionManagerCallback-146-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95220 INFO  (zkConnectionManagerCallback-145-thread-1-processing-n:127.0.0.1:39025_solr) [n:127.0.0.1:39025_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95347 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95347 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95347 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95347 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95347 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95348 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33523_solr
   [junit4]   2> 95348 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 95349 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.c.Overseer Overseer (id=72213593044877330-127.0.0.1:33523_solr-n_0000000000) starting
   [junit4]   2> 95350 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40557_solr
   [junit4]   2> 95350 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33255_solr
   [junit4]   2> 95350 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39025_solr
   [junit4]   2> 95350 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38319_solr
   [junit4]   2> 95350 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40701_solr
   [junit4]   2> 95364 INFO  (zkCallback-142-thread-1-processing-n:127.0.0.1:39025_solr) [n:127.0.0.1:39025_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95365 INFO  (zkCallback-144-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95365 INFO  (zkCallback-135-thread-1-processing-n:127.0.0.1:33255_solr) [n:127.0.0.1:33255_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95365 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:40557_solr) [n:127.0.0.1:40557_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95366 INFO  (zkCallback-140-thread-1-processing-n:127.0.0.1:38319_solr) [n:127.0.0.1:38319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95367 INFO  (zkCallback-136-thread-1-processing-n:127.0.0.1:40701_solr) [n:127.0.0.1:40701_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 95431 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33523_solr
   [junit4]   2> 95432 INFO  (zkCallback-136-thread-1-processing-n:127.0.0.1:40701_solr) [n:127.0.0.1:40701_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95432 INFO  (zkCallback-140-thread-1-processing-n:127.0.0.1:38319_solr) [n:127.0.0.1:38319_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95433 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:40557_solr) [n:127.0.0.1:40557_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95433 INFO  (zkCallback-135-thread-1-processing-n:127.0.0.1:33255_solr) [n:127.0.0.1:33255_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95433 INFO  (zkCallback-142-thread-1-processing-n:127.0.0.1:39025_solr) [n:127.0.0.1:39025_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95433 INFO  (zkCallback-144-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 95518 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38319.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95521 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33255.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95523 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40701.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95539 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39025.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95545 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38319.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95546 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38319.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95547 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33255.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95547 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33255.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95548 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40701.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95548 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40701.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95548 INFO  (jetty-launcher-95-thread-4) [n:127.0.0.1:38319_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node3/.
   [junit4]   2> 95549 INFO  (jetty-launcher-95-thread-1) [n:127.0.0.1:33255_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node1/.
   [junit4]   2> 95550 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40557.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95550 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95550 INFO  (jetty-launcher-95-thread-2) [n:127.0.0.1:40701_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node2/.
   [junit4]   2> 95553 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39025.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95553 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39025.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95554 INFO  (jetty-launcher-95-thread-3) [n:127.0.0.1:39025_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node4/.
   [junit4]   2> 95556 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95556 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95557 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40557.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95557 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40557.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 95557 INFO  (jetty-launcher-95-thread-5) [n:127.0.0.1:33523_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node5/.
   [junit4]   2> 95558 INFO  (jetty-launcher-95-thread-6) [n:127.0.0.1:40557_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node6/.
   [junit4]   2> 95793 INFO  (zkConnectionManagerCallback-160-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95800 INFO  (zkConnectionManagerCallback-164-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95802 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 95802 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38369/solr ready
   [junit4]   2> 95831 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[C339A0248F07D90B]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 95832 INFO  (zkConnectionManagerCallback-166-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 95833 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[C339A0248F07D90B]) [    ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
   [junit4]   2> 95905 INFO  (qtp566142576-478) [n:127.0.0.1:33255_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=9
   [junit4]   2> 95917 INFO  (qtp1196449378-439) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 95935 INFO  (qtp313573478-462) [n:127.0.0.1:38319_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 95958 INFO  (qtp1690738375-458) [n:127.0.0.1:39025_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 95979 INFO  (qtp1619221953-455) [n:127.0.0.1:40557_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 95998 INFO  (qtp842532245-474) [n:127.0.0.1:40701_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96000 INFO  (qtp1196449378-460) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=150
   [junit4]   2> 96002 INFO  (qtp1196449378-450) [n:127.0.0.1:33523_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 96012 INFO  (OverseerThreadFactory-202-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
   [junit4]   2> 96026 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96029 INFO  (qtp1196449378-457) [n:127.0.0.1:33523_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96031 INFO  (qtp313573478-467) [n:127.0.0.1:38319_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96034 INFO  (qtp1690738375-446) [n:127.0.0.1:39025_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96036 INFO  (qtp1619221953-453) [n:127.0.0.1:40557_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96038 INFO  (qtp842532245-470) [n:127.0.0.1:40701_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 96061 INFO  (OverseerThreadFactory-202-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2380357040 sessionWrapper.createTime 2380357018292710, this.sessionWrapper.createTime 2380357018292710 
   [junit4]   2> 96172 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40701/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96174 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40557/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96175 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39025/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96176 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38319/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96176 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n7",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33523/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96177 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96178 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n12",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33255/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96180 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n14",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33523/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96181 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n16",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38319/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96182 INFO  (OverseerStateUpdate-72213593044877330-127.0.0.1:33523_solr-n_0000000000) [n:127.0.0.1:33523_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n18",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39025/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 96418 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n3&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96419 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96419 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n1&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96420 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96422 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n2&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96422 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96423 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n5&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96423 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96484 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node17&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n14&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96485 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n7&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96484 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n16&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96485 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96485 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n10&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96486 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 96487 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node20&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n18&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96487 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n12&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 96606 INFO  (zkCallback-135-thread-1-processing-n:127.0.0.1:33255_solr) [n:127.0.0.1:33255_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-140-thread-1-processing-n:127.0.0.1:38319_solr) [n:127.0.0.1:38319_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-144-thread-1-processing-n:127.0.0.1:33523_solr) [n:127.0.0.1:33523_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-142-thread-1-processing-n:127.0.0.1:39025_solr) [n:127.0.0.1:39025_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-136-thread-1-processing-n:127.0.0.1:40701_solr) [n:127.0.0.1:40701_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-142-thread-2-processing-n:127.0.0.1:39025_solr) [n:127.0.0.1:39025_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96606 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:40557_solr) [n:127.0.0.1:40557_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96607 INFO  (zkCallback-140-thread-2-processing-n:127.0.0.1:38319_solr) [n:127.0.0.1:38319_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96607 INFO  (zkCallback-136-thread-2-processing-n:127.0.0.1:40701_solr) [n:127.0.0.1:40701_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 96607 INFO  (zkCallback-139-thread-2-processing-n:127.0.0.1:40557_solr) [n:127.0.0.1:40557_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 97462 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97485 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n2] Schema name=cloud-dynamic
   [junit4]   2> 97487 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97487 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97490 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97512 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n3] Schema name=cloud-dynamic
   [junit4]   2> 97513 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97516 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n5] Schema name=cloud-dynamic
   [junit4]   2> 97532 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97539 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97549 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97552 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n18] Schema name=cloud-dynamic
   [junit4]   2> 97555 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n1] Schema name=cloud-dynamic
   [junit4]   2> 97556 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97556 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n3' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97556 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97557 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39025.solr.core.replacenodetest_coll_notarget.shard2.replica_n3' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97557 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97557 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node4/replacenodetest_coll_notarget_shard2_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard2_replica_n3/data/]
   [junit4]   2> 97575 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97575 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n2' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97576 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 97579 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n16] Schema name=cloud-dynamic
   [junit4]   2> 97579 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n7] Schema name=cloud-dynamic
   [junit4]   2> 97582 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40557.solr.core.replacenodetest_coll_notarget.shard1.replica_n2' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97582 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97582 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node6/replacenodetest_coll_notarget_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node6/./replacenodetest_coll_notarget_shard1_replica_n2/data/]
   [junit4]   2> 97594 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n10] Schema name=cloud-dynamic
   [junit4]   2> 97597 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n14] Schema name=cloud-dynamic
   [junit4]   2> 97617 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n12] Schema name=cloud-dynamic
   [junit4]   2> 97621 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97621 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n5' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97622 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38319.solr.core.replacenodetest_coll_notarget.shard2.replica_n5' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97622 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97623 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node3/replacenodetest_coll_notarget_shard2_replica_n5], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard2_replica_n5/data/]
   [junit4]   2> 97636 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97636 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n18' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97637 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39025.solr.core.replacenodetest_coll_notarget.shard5.replica_n18' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n18') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97637 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97637 INFO  (qtp1690738375-427) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n18] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node4/replacenodetest_coll_notarget_shard5_replica_n18], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard5_replica_n18/data/]
   [junit4]   2> 97638 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97638 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n7' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97642 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.core.replacenodetest_coll_notarget.shard3.replica_n7' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97642 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97642 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n7] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node5/replacenodetest_coll_notarget_shard3_replica_n7], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node5/./replacenodetest_coll_notarget_shard3_replica_n7/data/]
   [junit4]   2> 97644 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97645 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n16' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97645 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38319.solr.core.replacenodetest_coll_notarget.shard5.replica_n16' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n16') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97645 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97645 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n16] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node3/replacenodetest_coll_notarget_shard5_replica_n16], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard5_replica_n16/data/]
   [junit4]   2> 97659 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97659 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n1' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97659 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40701.solr.core.replacenodetest_coll_notarget.shard1.replica_n1' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97659 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97659 INFO  (qtp842532245-471) [n:127.0.0.1:40701_solr c:replacenodetest_coll_notarget s:shard1 r:core_node4 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node2/replacenodetest_coll_notarget_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard1_replica_n1/data/]
   [junit4]   2> 97661 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97661 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n10' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97661 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97661 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n14' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97661 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33255.solr.core.replacenodetest_coll_notarget.shard3.replica_n10' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97661 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97662 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n10] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node1/replacenodetest_coll_notarget_shard3_replica_n10], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard3_replica_n10/data/]
   [junit4]   2> 97662 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33523.solr.core.replacenodetest_coll_notarget.shard4.replica_n14' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97662 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97662 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n14] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node5/replacenodetest_coll_notarget_shard4_replica_n14], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node5/./replacenodetest_coll_notarget_shard4_replica_n14/data/]
   [junit4]   2> 97672 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 97672 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n12' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 97672 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33255.solr.core.replacenodetest_coll_notarget.shard4.replica_n12' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fd4734c
   [junit4]   2> 97672 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 97672 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n12] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node1/replacenodetest_coll_notarget_shard4_replica_n12], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard4_replica_n12/data/]
   [junit4]   2> 97812 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97812 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97817 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97817 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97824 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@28ff9d7a[replacenodetest_coll_notarget_shard1_replica_n2] main]
   [junit4]   2> 97827 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 97827 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 97828 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97828 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97829 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97829 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97857 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97857 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97860 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 97860 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97860 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97860 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97860 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97861 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97861 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97862 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97862 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97865 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97865 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97866 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97866 INFO  (qtp1196449378-432) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97866 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97866 INFO  (qtp566142576-472) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97867 INFO  (searcherExecutor-216-thread-1-processing-n:127.0.0.1:40557_solr x:replacenodetest_coll_notarget_shard1_replica_n2 s:shard1 c:replacenodetest_coll_notarget r:core_node6) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard1_replica_n2] Registered new searcher Searcher@28ff9d7a[replacenodetest_coll_notarget_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 97867 INFO  (qtp1619221953-454) [n:127.0.0.1:40557_solr c:replacenodetest_coll_notarget s:shard1 r:core_node6 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593434123438915584
   [junit4]   2> 97868 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 97868 INFO  (qtp1196449378-445) [n:127.0.0.1:33523_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 97869 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.SolrIndexSearcher Opening [Searcher@2480d85a[replacenodetest_coll_notarget_shard3_replica_n10] main]
   [junit4]   2> 97870 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 97870 INFO  (qtp566142576-451) [n:127.0.0.1:33255_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 97870 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 97870 INFO  (qtp313573478-604) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 97871 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@71d198d[replacenodetest_coll_notarget_shard2_replica_n3] main]
   [junit4]   2> 97873 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@6376b442[replacenodetest_coll_notarget_shard2_replica_n5] main]
   [junit4]   2> 97873 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 97874 INFO  (qtp1690738375-452) [n:127.0.0.1:39025_solr c:replacenodetest_coll_notarget s:shard2 r:core_node8 x:replacenodetest_coll_notarget_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 97874 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 97874 INFO  (qtp313573478-465) [n:127.0.0.1:38319_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.jso

[...truncated too long message...]

41491_solr) [n:127.0.0.1:41491_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard1.leader, tag=716869366
   [junit4]   2> 17973 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@39533536{/solr,null,UNAVAILABLE}
   [junit4]   2> 17973 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 18179 WARN  (zkCallback-41-thread-1-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:35447_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:35447_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2> 	at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 19164 WARN  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 19164 INFO  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 19164 INFO  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard1_replica_n21]  CLOSING SolrCore org.apache.solr.core.SolrCore@79602ee7
   [junit4]   2> 19164 INFO  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.replacenodetest_coll_notarget.shard1.replica_n21, tag=2036346599
   [junit4]   2> 19165 INFO  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f180c9b: rootName = solr_41247, domain = solr.core.replacenodetest_coll_notarget.shard1.replica_n21, service url = null, agent id = null] for registry solr.core.replacenodetest_coll_notarget.shard1.replica_n21 / com.codahale.metrics.MetricRegistry@5c99a0c4
   [junit4]   2> 19171 INFO  (zkCallback-41-thread-2-processing-n:127.0.0.1:41247_solr) [n:127.0.0.1:41247_solr c:replacenodetest_coll_notarget s:shard1 r:core_node22 x:replacenodetest_coll_notarget_shard1_replica_n21] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard1.leader, tag=2036346599
   [junit4]   2> 19173 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4df848f9{/solr,null,UNAVAILABLE}
   [junit4]   2> 19173 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 19174 ERROR (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 19174 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[C339A0248F07D90B]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41683 41683
   [junit4]   2> 24232 INFO  (Thread-1) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41683 41683
   [junit4]   2> 24233 WARN  (Thread-1) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/replacenodetest_coll_notarget/terms/shard1
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/conf1
   [junit4]   2> 	6	/solr/collections/replacenodetest_coll_notarget/terms/shard5
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard2
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard4
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard3
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	71	/solr/collections/replacenodetest_coll_notarget/state.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72213870628765713-127.0.0.1:35447_solr-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/72213870628765711-127.0.0.1:40169_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_C339A0248F07D90B-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=100, maxMBSortInHeap=6.14251056130741, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@5eea227f), locale=de-CH, timezone=Indian/Kerguelen
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=365972840,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [ReplaceNodeNoTargetTest]
   [junit4] Completed [2/5 (1!)] on J2 in 25.36s, 1 test, 1 failure <<< FAILURES!

[...truncated 24 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 5 tests, 1 failure [seed: C339A0248F07D90B]

Total time: 43 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21535
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21535 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21535/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:     1) Thread[id=109, name=jetty-launcher-5-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)    2) Thread[id=112, name=jetty-launcher-5-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   1) Thread[id=109, name=jetty-launcher-5-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   2) Thread[id=112, name=jetty-launcher-5-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
	at __randomizedtesting.SeedInfo.seed([2F16EAEF50963C9]:0)




Build Log:
[...truncated 12115 lines...]
   [junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
   [junit4]   2> 32485 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2F16EAEF50963C9-001/init-core-data-001
   [junit4]   2> 32486 WARN  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 32486 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 32488 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 32537 WARN  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   2> 32622 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2F16EAEF50963C9-001/tempDir-001
   [junit4]   2> 32626 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 32628 INFO  (Thread-5) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 32628 INFO  (Thread-5) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 32697 ERROR (Thread-5) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 32728 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:41111
   [junit4]   2> 32785 INFO  (zkConnectionManagerCallback-8-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 32972 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 32972 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 32985 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 32985 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 32985 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 32985 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 32988 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 32988 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 33005 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e478c18{/solr,null,AVAILABLE}
   [junit4]   2> 33005 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d077f85{/solr,null,AVAILABLE}
   [junit4]   2> 33037 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1e5e33e{SSL,[ssl, http/1.1]}{127.0.0.1:33675}
   [junit4]   2> 33037 INFO  (jetty-launcher-5-thread-2) [    ] o.e.j.s.Server Started @34605ms
   [junit4]   2> 33037 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33675}
   [junit4]   2> 33037 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6cebe180{SSL,[ssl, http/1.1]}{127.0.0.1:40551}
   [junit4]   2> 33038 INFO  (jetty-launcher-5-thread-1) [    ] o.e.j.s.Server Started @34606ms
   [junit4]   2> 33038 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40551}
   [junit4]   2> 33053 ERROR (jetty-launcher-5-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 33053 ERROR (jetty-launcher-5-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 33053 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 33053 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solrâ„¢ version 8.0.0
   [junit4]   2> 33054 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 33055 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 33055 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 33058 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 33061 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T00:54:04.319Z
   [junit4]   2> 33062 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 33063 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-26T00:54:04.322Z
   [junit4]   2> 33082 INFO  (zkConnectionManagerCallback-10-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33092 INFO  (zkConnectionManagerCallback-12-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33092 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 33096 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 33152 INFO  (jetty-launcher-5-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41111/solr
   [junit4]   2> 33155 INFO  (jetty-launcher-5-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41111/solr
   [junit4]   2> 33174 INFO  (zkConnectionManagerCallback-20-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33175 INFO  (zkConnectionManagerCallback-19-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33187 INFO  (zkConnectionManagerCallback-22-thread-1-processing-n:127.0.0.1:33675_solr) [n:127.0.0.1:33675_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33191 INFO  (zkConnectionManagerCallback-24-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 33406 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 33406 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 33408 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33675_solr
   [junit4]   2> 33409 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40551_solr
   [junit4]   2> 33410 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.Overseer Overseer (id=72212888429264901-127.0.0.1:33675_solr-n_0000000000) starting
   [junit4]   2> 33457 INFO  (zkCallback-23-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 33464 INFO  (zkCallback-21-thread-1-processing-n:127.0.0.1:33675_solr) [n:127.0.0.1:33675_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 33555 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 33572 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 33627 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33675_solr
   [junit4]   2> 33631 INFO  (zkCallback-23-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 33632 INFO  (zkCallback-21-thread-1-processing-n:127.0.0.1:33675_solr) [n:127.0.0.1:33675_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 33672 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 33672 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 33714 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 33715 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 33777 INFO  (jetty-launcher-5-thread-2-EventThread) [n:127.0.0.1:33675_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 33777 INFO  (jetty-launcher-5-thread-1-EventThread) [n:127.0.0.1:40551_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 34863 ERROR (Finalizer) [    ] o.a.s.u.ConcurrentLFUCache ConcurrentLFUCache was not destroyed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
   [junit4]   2> 34960 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 34960 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 35017 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33675.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35051 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33675.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35052 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33675.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35055 INFO  (jetty-launcher-5-thread-2) [n:127.0.0.1:33675_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2F16EAEF50963C9-001/tempDir-001/node2/.
   [junit4]   2> 35063 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40551.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35064 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40551.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35064 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40551.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c4876f
   [junit4]   2> 35066 INFO  (jetty-launcher-5-thread-1) [n:127.0.0.1:40551_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_2F16EAEF50963C9-001/tempDir-001/node1/.
   [junit4]   2> 35198 INFO  (zkConnectionManagerCallback-30-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 35219 INFO  (zkConnectionManagerCallback-34-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 35221 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 35221 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41111/solr ready
   [junit4]   2> 35239 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 35628 INFO  (qtp1161840284-73) [n:127.0.0.1:33675_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 35629 INFO  (qtp1161840284-73) [n:127.0.0.1:33675_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 35662 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=simple-dt&e=1519642446761&s=b1hBtMLGd3xEsEN1Yz31D1ZOyDc="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:06 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:06 GMT
   [junit4]   2> 35679 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 35698 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 35730 WARN  (qtp1161840284-71) [    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ‘bar’: no such user
   [junit4]   2> id: ‘bar’: no such user
   [junit4]   2> 
   [junit4]   2> 36058 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=simple-dt&e=1519642446983&s=7TVGE8R+dMlVNGl85S7s/623W/I="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:06 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:06 GMT
   [junit4]   2> 36060 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 36069 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 36098 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=simple-dt&e=1519642447352&s=M65s4FyLThu06Cxd8qWjsuhDRqQ="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 36100 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 36117 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 36129 INFO  (qtp1161840284-71) [n:127.0.0.1:33675_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 36129 INFO  (qtp1161840284-71) [n:127.0.0.1:33675_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 36132 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=simple-dt&e=1519642447387&s=VvZHBWgbKcG7hGS0Pgmq5oxLPV0="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 36132 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 36148 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 36156 INFO  (qtp1161840284-61) [n:127.0.0.1:33675_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 36157 INFO  (qtp1161840284-61) [n:127.0.0.1:33675_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 36158 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=simple-dt&e=1519642447415&s=8wT3J5tfzpK0aF3BWWEvD9GrcJQ="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 36158 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 36167 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 36182 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=simple-dt&e=1519642447437&s=xnqOr0fnfhY2HEaBsyna+6xetus="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 36183 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 36197 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 36206 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=simple-dt&e=1519642447462&s=sQP/krASN+41KIeHtAklsIOzT3s="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 36206 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 36223 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 36232 INFO  (qtp1161840284-65) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:289)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:149)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 36235 WARN  (qtp1161840284-65) [    ] o.e.j.s.HttpChannel /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:460)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:289)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:149)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:454)
   [junit4]   2> 	... 34 more
   [junit4]   2> 36243 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4] IGNOR/A 0.00s J2 | TestImpersonationWithHadoopAuth.testForwarding
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/HADOOP-9893))
   [junit4]   2> 36257 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 48599 WARN  (jetty-launcher-5-thread-1-SendThread(127.0.0.1:41111)) [n:127.0.0.1:40551_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13517ms for sessionid 0x1008d3d4b080006
   [junit4]   2> 48599 WARN  (jetty-launcher-5-thread-1-SendThread(127.0.0.1:41111)) [n:127.0.0.1:40551_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13642ms for sessionid 0x1008d3d4b080008
   [junit4]   2> 48599 WARN  (jetty-launcher-5-thread-2-SendThread(127.0.0.1:41111)) [n:127.0.0.1:33675_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13642ms for sessionid 0x1008d3d4b080007
   [junit4]   2> 48599 WARN  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker-SendThread(127.0.0.1:41111)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13371ms for sessionid 0x1008d3d4b08000a
   [junit4]   2> 48600 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008d3d4b080008, likely client has closed socket
   [junit4]   2> 48600 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008d3d4b080006, likely client has closed socket
   [junit4]   2> 48600 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008d3d4b080007, likely client has closed socket
   [junit4]   2> 48602 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[2F16EAEF50963C9]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=simple-dt&e=1519642447524&s=uL1xWul74Ti+1P0ahnd4QgiYEAs="; Domain=127.0.0.1; Expires=H, 26-febr.-2018 10:54:07 GMT; Secure; HttpOnly". Invalid 'expires' attribute: H, 26-febr.-2018 10:54:07 GMT
   [junit4]   2> 48602 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[2F16EAEF50963C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 48700 WARN  (zkConnectionManagerCallback-24-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@465d787 name: ZooKeeperConnection Watcher:127.0.0.1:41111/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 48700 WARN  (zkConnectionManagerCallback-24-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 48705 INFO  (jetty-closer-6-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@6cebe180{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 48705 INFO  (jetty-closer-6-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1e5e33e{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 48705 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1864453187
   [junit4]   2> 48705 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=165521313
   [junit4]   2> 48706 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 48706 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 48706 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@48f90b2c: rootName = solr_40551, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@497fa59f
   [junit4]   2> 48706 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4466adc6: rootName = solr_33675, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@10da8a63
   [junit4]   2> 48714 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 48714 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 48714 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c8492df: rootName = solr_33675, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@df0f64e
   [junit4]   2> 48714 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5249283f: rootName = solr_40551, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@df0f64e
   [junit4]   2> 48719 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 48719 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 48719 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67158a29: rootName = solr_33675, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6acfae36
   [junit4]   2> 48719 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30d3e317: rootName = solr_40551, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6acfae36
   [junit4]   2> 48721 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33675_solr
   [junit4]   2> 48721 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 48722 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 48722 INFO  (zkCallback-21-thread-1-processing-n:127.0.0.1:33675_solr) [n:127.0.0.1:33675_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 48723 INFO  (jetty-closer-6-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72212888429264901-127.0.0.1:33675_solr-n_0000000000) closing
   [junit4]   2> 48723 INFO  (OverseerStateUpdate-72212888429264901-127.0.0.1:33675_solr-n_0000000000) [n:127.0.0.1:33675_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33675_solr
   [junit4]   2> 48723 WARN  (OverseerAutoScalingTriggerThread-72212888429264901-127.0.0.1:33675_solr-n_0000000000) [n:127.0.0.1:33675_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 48725 ERROR (Thread[Thread-25,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:33675_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 48993 INFO  (jetty-closer-6-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d077f85{/solr,null,UNAVAILABLE}
   [junit4]   2> 48994 INFO  (jetty-closer-6-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 49740 INFO  (zkConnectionManagerCallback-24-thread-1-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 49741 INFO  (zkCallback-23-thread-4-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40551_solr
   [junit4]   2> 49741 INFO  (zkCallback-23-thread-2-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 49741 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40551_solr
   [junit4]   2> 49742 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 49742 INFO  (jetty-closer-6-thread-2) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 49742 INFO  (zkCallback-23-thread-4-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 50421 INFO  (jetty-launcher-5-thread-1-EventThread) [n:127.0.0.1:40551_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 51243 WARN  (zkCallback-23-thread-4-processing-n:127.0.0.1:40551_solr) [n:127.0.0.1:40551_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:40551_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:40551_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2> 	at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 51244 ERROR (Thread[Thread-23,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:40551_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 51245 INFO  (jetty-closer-6-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e478c18{/solr,null,UNAVAILABLE}
   [junit4]   2> 51245 INFO  (jetty-closer-6-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 51245 ERROR (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 51246 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41111 41111
   [junit4]   2> 57186 INFO  (Thread-5) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41111 41111
   [junit4]   2> 57187 WARN  (Thread-5) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 57187 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[2F16EAEF50963C9]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 26, 2018 12:54:28 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Feb 26, 2018 12:54:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]   2>    1) Thread[id=109, name=jetty-launcher-5-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2>    2) Thread[id=112, name=jetty-launcher-5-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> Feb 26, 2018 12:54:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=109, name=jetty-launcher-5-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>    2) Thread[id=112, name=jetty-launcher-5-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2> 77249 ERROR (jetty-launcher-5-thread-2-EventThread) [n:127.0.0.1:33675_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> 77249 ERROR (jetty-launcher-5-thread-1-EventThread) [n:127.0.0.1:40551_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> Feb 26, 2018 12:54:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1780, maxMBSortInHeap=7.696563562224869, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3203a7f7), locale=hu, timezone=Australia/Sydney
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=356885824,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestLFUCache, TestJmxIntegration, TestImpersonationWithHadoopAuth]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=2F16EAEF50963C9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Australia/Sydney -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | TestImpersonationWithHadoopAuth (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]    >    1) Thread[id=109, name=jetty-launcher-5-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]    >    2) Thread[id=112, name=jetty-launcher-5-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2F16EAEF50963C9]:0)
   [junit4] Completed [16/778 (1!)] on J2 in 44.79s, 10 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 51000 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21535/consoleText

[repro] Revision: b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af

[repro] Repro line:  ant test  -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=2F16EAEF50963C9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Australia/Sydney -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestImpersonationWithHadoopAuth
[repro] ant compile-test

[...truncated 3292 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestImpersonationWithHadoopAuth" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC" -Dtests.seed=2F16EAEF50963C9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Australia/Sydney -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 121 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.4) - Build # 21534 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21534/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseParallelGC

No tests ran.

Build Log:
[...truncated 55897 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21534/consoleText

[repro] Revision: b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] No "reproduce with" lines found; exiting.

[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21533 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21533/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseSerialGC

No tests ran.

Build Log:
[...truncated 63149 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21533/consoleText

[repro] Revision: b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] No "reproduce with" lines found; exiting.

[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21532 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21532/
Java: 64bit/jdk1.8.0_162 -XX:+UseCompressedOops -XX:+UseParallelGC

3 tests failed.
FAILED:  org.apache.solr.cloud.ReplaceNodeNoTargetTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([2F4813E71EB872E9:A71C2C3DB0441F11]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ReplaceNodeNoTargetTest.test(ReplaceNodeNoTargetTest.java:92)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestUtilizeNode.test

Error Message:
no replica should be present in  127.0.0.1:33283_solr

Stack Trace:
java.lang.AssertionError: no replica should be present in  127.0.0.1:33283_solr
	at __randomizedtesting.SeedInfo.seed([2F4813E71EB872E9:A71C2C3DB0441F11]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.TestUtilizeNode.test(TestUtilizeNode.java:99)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
	at __randomizedtesting.SeedInfo.seed([2F4813E71EB872E9:42B4B71AA4F08DEE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:313)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12536 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplaceNodeNoTargetTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/init-core-data-001
   [junit4]   2> 425951 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 425952 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 425953 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 425953 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001
   [junit4]   2> 425953 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 425953 INFO  (Thread-836) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 425953 INFO  (Thread-836) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 425955 ERROR (Thread-836) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 426053 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39433
   [junit4]   2> 426076 INFO  (zkConnectionManagerCallback-804-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426083 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426092 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426096 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426101 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426112 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426115 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 426118 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426118 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426118 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 426119 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a46c232{/solr,null,AVAILABLE}
   [junit4]   2> 426124 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426124 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426124 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 426125 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f1a8a97{/solr,null,AVAILABLE}
   [junit4]   2> 426127 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426127 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426127 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 426127 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2baa4256{/solr,null,AVAILABLE}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1112f3dc{SSL,[ssl, http/1.1]}{127.0.0.1:33419}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-3) [    ] o.e.j.s.Server Started @428100ms
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33419}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2b146d73{SSL,[ssl, http/1.1]}{127.0.0.1:42379}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-1) [    ] o.e.j.s.Server Started @428100ms
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42379}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5b5fdaf1{SSL,[ssl, http/1.1]}{127.0.0.1:38513}
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.e.j.s.Server Started @428100ms
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38513}
   [junit4]   2> 426138 ERROR (jetty-launcher-801-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426138 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.037Z
   [junit4]   2> 426188 ERROR (jetty-launcher-801-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426189 ERROR (jetty-launcher-801-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.088Z
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426189 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.088Z
   [junit4]   2> 426203 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426203 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426203 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 426211 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@187ae56b{/solr,null,AVAILABLE}
   [junit4]   2> 426235 INFO  (zkConnectionManagerCallback-809-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426236 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426243 INFO  (zkConnectionManagerCallback-806-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426243 INFO  (zkConnectionManagerCallback-810-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426244 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426244 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426247 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008ab192eb0002, likely client has closed socket
   [junit4]   2> 426247 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426247 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426247 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b1539ee{/solr,null,AVAILABLE}
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3e86ac91{SSL,[ssl, http/1.1]}{127.0.0.1:34135}
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.e.j.s.Server Started @428210ms
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34135}
   [junit4]   2> 426248 ERROR (jetty-launcher-801-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426248 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426249 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.147Z
   [junit4]   2> 426251 INFO  (zkConnectionManagerCallback-812-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426252 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426259 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6bf0e2b9{SSL,[ssl, http/1.1]}{127.0.0.1:36789}
   [junit4]   2> 426259 INFO  (jetty-launcher-801-thread-5) [    ] o.e.j.s.Server Started @428222ms
   [junit4]   2> 426259 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36789}
   [junit4]   2> 426259 ERROR (jetty-launcher-801-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426260 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426260 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426260 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426260 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.159Z
   [junit4]   2> 426263 INFO  (jetty-launcher-801-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426271 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 426275 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 426276 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 426276 INFO  (jetty-launcher-801-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426279 INFO  (zkConnectionManagerCallback-818-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426283 INFO  (zkConnectionManagerCallback-815-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426283 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@234b9103{/solr,null,AVAILABLE}
   [junit4]   2> 426283 INFO  (jetty-launcher-801-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426284 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426303 INFO  (zkConnectionManagerCallback-828-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426307 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@149eb4a5{SSL,[ssl, http/1.1]}{127.0.0.1:39447}
   [junit4]   2> 426307 INFO  (jetty-launcher-801-thread-6) [    ] o.e.j.s.Server Started @428270ms
   [junit4]   2> 426307 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39447}
   [junit4]   2> 426308 INFO  (jetty-launcher-801-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426308 ERROR (jetty-launcher-801-thread-6) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 426308 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 426308 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 426308 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 426308 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T13:02:13.207Z
   [junit4]   2> 426315 INFO  (zkConnectionManagerCallback-823-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426327 INFO  (zkConnectionManagerCallback-834-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426327 INFO  (zkConnectionManagerCallback-832-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426327 INFO  (zkConnectionManagerCallback-826-thread-1-processing-n:127.0.0.1:38513_solr) [n:127.0.0.1:38513_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426328 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 426339 INFO  (jetty-launcher-801-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426340 INFO  (zkConnectionManagerCallback-839-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426345 INFO  (jetty-launcher-801-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39433/solr
   [junit4]   2> 426351 INFO  (zkConnectionManagerCallback-843-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426353 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426356 INFO  (zkConnectionManagerCallback-838-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426356 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33419_solr
   [junit4]   2> 426356 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1008ab192eb000d, likely client has closed socket
   [junit4]   2> 426366 INFO  (zkConnectionManagerCallback-849-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426366 INFO  (zkConnectionManagerCallback-845-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426367 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.c.Overseer Overseer (id=72210089316646924-127.0.0.1:33419_solr-n_0000000000) starting
   [junit4]   2> 426374 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426374 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42379_solr
   [junit4]   2> 426375 INFO  (zkConnectionManagerCallback-854-thread-1-processing-n:127.0.0.1:39447_solr) [n:127.0.0.1:39447_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426375 INFO  (zkConnectionManagerCallback-852-thread-1-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426384 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 426384 INFO  (zkCallback-836-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 426389 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 426390 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426390 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33419_solr
   [junit4]   2> 426391 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 426396 INFO  (zkCallback-836-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 426396 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 426397 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34135_solr
   [junit4]   2> 426397 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 426398 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 426398 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 426399 INFO  (zkCallback-836-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 426400 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426401 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 426401 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426402 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36789_solr
   [junit4]   2> 426403 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 426404 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 426409 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 426410 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 426411 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39447_solr
   [junit4]   2> 426413 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 426425 INFO  (zkCallback-851-thread-1-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 426427 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38513_solr
   [junit4]   2> 426428 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 426428 INFO  (zkCallback-837-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 426428 INFO  (zkCallback-836-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (6)
   [junit4]   2> 426428 INFO  (zkCallback-851-thread-2-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
   [junit4]   2> 426433 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 426445 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42379.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426450 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42379.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426450 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42379.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426451 INFO  (jetty-launcher-801-thread-1) [n:127.0.0.1:42379_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node1/.
   [junit4]   2> 426452 INFO  (zkCallback-825-thread-1-processing-n:127.0.0.1:38513_solr) [n:127.0.0.1:38513_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
   [junit4]   2> 426452 INFO  (zkCallback-853-thread-1-processing-n:127.0.0.1:39447_solr) [n:127.0.0.1:39447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (6)
   [junit4]   2> 426464 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33419.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426470 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426481 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38513.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426491 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36789.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426502 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33419.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426502 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33419.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426507 INFO  (jetty-launcher-801-thread-3) [n:127.0.0.1:33419_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node3/.
   [junit4]   2> 426509 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426509 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426511 INFO  (jetty-launcher-801-thread-4) [n:127.0.0.1:34135_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node4/.
   [junit4]   2> 426511 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39447.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426513 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38513.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426513 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38513.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426514 INFO  (jetty-launcher-801-thread-2) [n:127.0.0.1:38513_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node2/.
   [junit4]   2> 426516 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36789.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426517 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36789.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426518 INFO  (jetty-launcher-801-thread-5) [n:127.0.0.1:36789_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node5/.
   [junit4]   2> 426518 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39447.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426519 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39447.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 426519 INFO  (jetty-launcher-801-thread-6) [n:127.0.0.1:39447_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node6/.
   [junit4]   2> 426764 INFO  (zkConnectionManagerCallback-866-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426767 INFO  (zkConnectionManagerCallback-870-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426768 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (6)
   [junit4]   2> 426768 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39433/solr ready
   [junit4]   2> 426799 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[2F4813E71EB872E9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 426802 INFO  (zkConnectionManagerCallback-872-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 426803 INFO  (TEST-ReplaceNodeNoTargetTest.test-seed#[2F4813E71EB872E9]) [    ] o.a.s.c.ReplaceNodeNoTargetTest total_jettys: 6
   [junit4]   2> 426857 INFO  (qtp1063068229-4377) [n:127.0.0.1:33419_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426870 INFO  (qtp1544154256-4426) [n:127.0.0.1:34135_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426881 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426894 INFO  (qtp946988963-4388) [n:127.0.0.1:38513_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426908 INFO  (qtp1963823235-4433) [n:127.0.0.1:39447_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426916 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426917 INFO  (qtp1636346455-4395) [n:127.0.0.1:42379_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=95
   [junit4]   2> 426918 INFO  (qtp1636346455-4391) [n:127.0.0.1:42379_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=conf1&name=replacenodetest_coll_notarget&nrtReplicas=2&action=CREATE&numShards=5&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 426919 INFO  (OverseerThreadFactory-1883-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection replacenodetest_coll_notarget
   [junit4]   2> 426935 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426941 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426960 INFO  (qtp295965414-4400) [n:127.0.0.1:36789_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426965 INFO  (qtp946988963-4387) [n:127.0.0.1:38513_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426976 INFO  (qtp1963823235-4435) [n:127.0.0.1:39447_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 426979 INFO  (qtp1636346455-4396) [n:127.0.0.1:42379_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 427000 INFO  (OverseerThreadFactory-1883-thread-1-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2326894336 sessionWrapper.createTime 2326894316634122, this.sessionWrapper.createTime 2326894316634122 
   [junit4]   2> 427107 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42379/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427108 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39447/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427110 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38513/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427112 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36789/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427113 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427115 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard3_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33419/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427116 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n12",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:33419/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427117 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard4_replica_n14",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34135/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427119 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n16",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36789/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427120 INFO  (OverseerStateUpdate-72210089316646924-127.0.0.1:33419_solr-n_0000000000) [n:127.0.0.1:33419_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"replacenodetest_coll_notarget",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"replacenodetest_coll_notarget_shard5_replica_n18",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38513/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 427324 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n1&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427324 INFO  (qtp1963823235-4415) [n:127.0.0.1:39447_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard1_replica_n2&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427324 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427324 INFO  (qtp1963823235-4415) [n:127.0.0.1:39447_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427329 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n4&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427329 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427330 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard2_replica_n6&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427330 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427333 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n10&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427333 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427335 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n12&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427340 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n16&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427341 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node17&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard4_replica_n14&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427341 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 427377 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard3_replica_n8&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427380 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node20&collection.configName=conf1&newCollection=true&name=replacenodetest_coll_notarget_shard5_replica_n18&action=CREATE&numShards=5&collection=replacenodetest_coll_notarget&shard=shard5&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 427482 INFO  (zkCallback-851-thread-2-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-844-thread-1-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-837-thread-2-processing-n:127.0.0.1:33419_solr) [n:127.0.0.1:33419_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-825-thread-2-processing-n:127.0.0.1:38513_solr) [n:127.0.0.1:38513_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-851-thread-1-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-825-thread-1-processing-n:127.0.0.1:38513_solr) [n:127.0.0.1:38513_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-836-thread-1-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-844-thread-2-processing-n:127.0.0.1:34135_solr) [n:127.0.0.1:34135_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-853-thread-1-processing-n:127.0.0.1:39447_solr) [n:127.0.0.1:39447_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427482 INFO  (zkCallback-836-thread-2-processing-n:127.0.0.1:42379_solr) [n:127.0.0.1:42379_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427483 INFO  (zkCallback-851-thread-3-processing-n:127.0.0.1:36789_solr) [n:127.0.0.1:36789_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 427483 INFO  (zkCallback-853-thread-2-processing-n:127.0.0.1:39447_solr) [n:127.0.0.1:39447_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [6])
   [junit4]   2> 428356 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428360 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n12] Schema name=cloud-dynamic
   [junit4]   2> 428369 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428373 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428392 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428392 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n12' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428393 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33419.solr.core.replacenodetest_coll_notarget.shard4.replica_n12' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428393 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428393 INFO  (qtp1063068229-4378) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard4 r:core_node15 x:replacenodetest_coll_notarget_shard4_replica_n12] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n12] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node3/replacenodetest_coll_notarget_shard4_replica_n12], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard4_replica_n12/data/]
   [junit4]   2> 428394 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n1] Schema name=cloud-dynamic
   [junit4]   2> 428400 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428402 INFO  (qtp1963823235-4415) [n:127.0.0.1:39447_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428402 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428404 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n10] Schema name=cloud-dynamic
   [junit4]   2> 428406 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428400 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428417 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428424 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard3_replica_n8] Schema name=cloud-dynamic
   [junit4]   2> 428426 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n18] Schema name=cloud-dynamic
   [junit4]   2> 428427 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard5_replica_n16] Schema name=cloud-dynamic
   [junit4]   2> 428433 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 428435 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n4] Schema name=cloud-dynamic
   [junit4]   2> 428449 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard4_replica_n14] Schema name=cloud-dynamic
   [junit4]   2> 428450 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428450 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard1_replica_n1' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428451 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42379.solr.core.replacenodetest_coll_notarget.shard1.replica_n1' (registry 'solr.core.replacenodetest_coll_notarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428451 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428451 INFO  (qtp1636346455-4397) [n:127.0.0.1:42379_solr c:replacenodetest_coll_notarget s:shard1 r:core_node3 x:replacenodetest_coll_notarget_shard1_replica_n1] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node1/replacenodetest_coll_notarget_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node1/./replacenodetest_coll_notarget_shard1_replica_n1/data/]
   [junit4]   2> 428455 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard2_replica_n6] Schema name=cloud-dynamic
   [junit4]   2> 428462 INFO  (qtp1963823235-4415) [n:127.0.0.1:39447_solr c:replacenodetest_coll_notarget s:shard1 r:core_node5 x:replacenodetest_coll_notarget_shard1_replica_n2] o.a.s.s.IndexSchema [replacenodetest_coll_notarget_shard1_replica_n2] Schema name=cloud-dynamic
   [junit4]   2> 428463 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428463 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n16' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428463 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36789.solr.core.replacenodetest_coll_notarget.shard5.replica_n16' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n16') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428463 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428463 INFO  (qtp295965414-4399) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n16] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node5/replacenodetest_coll_notarget_shard5_replica_n16], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node5/./replacenodetest_coll_notarget_shard5_replica_n16/data/]
   [junit4]   2> 428463 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428464 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard5_replica_n18' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428464 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38513.solr.core.replacenodetest_coll_notarget.shard5.replica_n18' (registry 'solr.core.replacenodetest_coll_notarget.shard5.replica_n18') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428464 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428464 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard5_replica_n18] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node2/replacenodetest_coll_notarget_shard5_replica_n18], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard5_replica_n18/data/]
   [junit4]   2> 428481 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428481 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n10' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428482 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33419.solr.core.replacenodetest_coll_notarget.shard3.replica_n10' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428482 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428482 INFO  (qtp1063068229-4373) [n:127.0.0.1:33419_solr c:replacenodetest_coll_notarget s:shard3 r:core_node13 x:replacenodetest_coll_notarget_shard3_replica_n10] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n10] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node3/replacenodetest_coll_notarget_shard3_replica_n10], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node3/./replacenodetest_coll_notarget_shard3_replica_n10/data/]
   [junit4]   2> 428498 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428498 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard4_replica_n14' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428499 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.core.replacenodetest_coll_notarget.shard4.replica_n14' (registry 'solr.core.replacenodetest_coll_notarget.shard4.replica_n14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428499 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428499 INFO  (qtp1544154256-4425) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard4_replica_n14] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node4/replacenodetest_coll_notarget_shard4_replica_n14], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard4_replica_n14/data/]
   [junit4]   2> 428522 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428522 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard3_replica_n8' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428522 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.core.replacenodetest_coll_notarget.shard3.replica_n8' (registry 'solr.core.replacenodetest_coll_notarget.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428523 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428523 INFO  (qtp1544154256-4556) [n:127.0.0.1:34135_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard3_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node4/replacenodetest_coll_notarget_shard3_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node4/./replacenodetest_coll_notarget_shard3_replica_n8/data/]
   [junit4]   2> 428543 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 428543 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 428544 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 428545 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 428546 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.s.SolrIndexSearcher Opening [Searcher@72b36397[replacenodetest_coll_notarget_shard5_replica_n18] main]
   [junit4]   2> 428547 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 428547 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 428548 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428549 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n4' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428549 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38513.solr.core.replacenodetest_coll_notarget.shard2.replica_n4' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428549 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428549 INFO  (qtp946988963-4382) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard2 r:core_node7 x:replacenodetest_coll_notarget_shard2_replica_n4] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node2/replacenodetest_coll_notarget_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node2/./replacenodetest_coll_notarget_shard2_replica_n4/data/]
   [junit4]   2> 428553 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 428557 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 428557 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'replacenodetest_coll_notarget_shard2_replica_n6' using configuration from collection replacenodetest_coll_notarget, trusted=true
   [junit4]   2> 428558 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36789.solr.core.replacenodetest_coll_notarget.shard2.replica_n6' (registry 'solr.core.replacenodetest_coll_notarget.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e86708e
   [junit4]   2> 428558 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 428558 INFO  (qtp295965414-4406) [n:127.0.0.1:36789_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.c.SolrCore [[replacenodetest_coll_notarget_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node5/replacenodetest_coll_notarget_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001/tempDir-001/node5/./replacenodetest_coll_notarget_shard2_replica_n6/data/]
   [junit4]   2> 428559 INFO  (searcherExecutor-1898-thread-1-processing-n:127.0.0.1:38513_solr x:replacenodetest_coll_notarget_shard5_replica_n18 s:shard5 c:replacenodetest_coll_notarget r:core_node20) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.c.SolrCore [replacenodetest_coll_notarget_shard5_replica_n18] Registered new searcher Searcher@72b36397[replacenodetest_coll_notarget_shard5_replica_n18] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 428559 INFO  (qtp946988963-4562) [n:127.0.0.1:38513_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetes

[...truncated too long message...]

]   2> 28647 INFO  (zkCallback-128-thread-3-processing-n:127.0.0.1:43505_solr) [n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 28646 INFO  (zkCallback-128-thread-1-processing-n:127.0.0.1:43505_solr) [n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/replacenodetest_coll_notarget/state.json] for collection [replacenodetest_coll_notarget] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 28652 INFO  (jetty-closer-81-thread-6) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@68d03c07{/solr,null,UNAVAILABLE}
   [junit4]   2> 28652 INFO  (jetty-closer-81-thread-6) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 28653 INFO  (coreCloseExecutor-180-thread-2) [n:127.0.0.1:36069_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.replacenodetest_coll_notarget.shard3.replica_n8, tag=823894162
   [junit4]   2> 28653 INFO  (coreCloseExecutor-180-thread-2) [n:127.0.0.1:36069_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a528f5e: rootName = solr_36069, domain = solr.core.replacenodetest_coll_notarget.shard3.replica_n8, service url = null, agent id = null] for registry solr.core.replacenodetest_coll_notarget.shard3.replica_n8 / com.codahale.metrics.MetricRegistry@7c3d14d8
   [junit4]   2> 28655 INFO  (coreCloseExecutor-178-thread-2) [n:127.0.0.1:39211_solr c:replacenodetest_coll_notarget s:shard5 r:core_node20 x:replacenodetest_coll_notarget_shard5_replica_n18] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard5.leader, tag=2078214219
   [junit4]   2> 28657 INFO  (coreCloseExecutor-179-thread-2) [n:127.0.0.1:37561_solr c:replacenodetest_coll_notarget s:shard5 r:core_node19 x:replacenodetest_coll_notarget_shard5_replica_n16] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard5.leader, tag=1367979356
   [junit4]   2> 28658 INFO  (coreCloseExecutor-179-thread-1) [n:127.0.0.1:37561_solr c:replacenodetest_coll_notarget s:shard2 r:core_node9 x:replacenodetest_coll_notarget_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard2.leader, tag=1405405404
   [junit4]   2> 28663 INFO  (coreCloseExecutor-180-thread-1) [n:127.0.0.1:36069_solr c:replacenodetest_coll_notarget s:shard4 r:core_node17 x:replacenodetest_coll_notarget_shard4_replica_n14] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard4.leader, tag=1471340603
   [junit4]   2> 28663 INFO  (coreCloseExecutor-180-thread-2) [n:127.0.0.1:36069_solr c:replacenodetest_coll_notarget s:shard3 r:core_node11 x:replacenodetest_coll_notarget_shard3_replica_n8] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.replacenodetest_coll_notarget.shard3.leader, tag=823894162
   [junit4]   2> 28703 INFO  (jetty-closer-81-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@68c02bb4{/solr,null,UNAVAILABLE}
   [junit4]   2> 28703 INFO  (jetty-closer-81-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 28704 INFO  (jetty-closer-81-thread-5) [    ] o.a.s.c.Overseer Overseer (id=72210306805530635-127.0.0.1:37561_solr-n_0000000000) closing
   [junit4]   2> 28704 INFO  (OverseerStateUpdate-72210306805530635-127.0.0.1:37561_solr-n_0000000000) [n:127.0.0.1:37561_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37561_solr
   [junit4]   2> 28704 INFO  (jetty-closer-81-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@69a73998{/solr,null,UNAVAILABLE}
   [junit4]   2> 28704 INFO  (jetty-closer-81-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 28706 WARN  (OverseerAutoScalingTriggerThread-72210306805530635-127.0.0.1:37561_solr-n_0000000000) [n:127.0.0.1:37561_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 28707 INFO  (jetty-closer-81-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48320d51{/solr,null,UNAVAILABLE}
   [junit4]   2> 28707 INFO  (jetty-closer-81-thread-5) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 28708 ERROR (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 28708 INFO  (SUITE-ReplaceNodeNoTargetTest-seed#[2F4813E71EB872E9]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43389 43389
   [junit4]   2> 33734 INFO  (Thread-73) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43389 43389
   [junit4]   2> 33735 WARN  (Thread-73) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/replacenodetest_coll_notarget/terms/shard1
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/conf1
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard2
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard4
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard3
   [junit4]   2> 	5	/solr/collections/replacenodetest_coll_notarget/terms/shard5
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	81	/solr/collections/replacenodetest_coll_notarget/state.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72210306805530635-127.0.0.1:37561_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/replacenodetest_coll_notarget/leader_elect/shard1/election/72210306805530640-core_node5-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/72210306805530638-127.0.0.1:39211_solr-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/72210306805530640-127.0.0.1:43505_solr-n_0000000002
   [junit4]   2> 	2	/solr/overseer_elect/election/72210306805530641-127.0.0.1:33079_solr-n_0000000003
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReplaceNodeNoTargetTest_2F4813E71EB872E9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1545, maxMBSortInHeap=6.142436934784754, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1bbc820f), locale=en-AU, timezone=America/Fort_Wayne
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=370177520,total=494403584
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtilizeNode, ReplaceNodeNoTargetTest]
   [junit4] Completed [3/15 (2!)] on J2 in 12.40s, 1 test, 1 failure <<< FAILURES!

[...truncated 63 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 15 suites, 15 tests, 2 failures [seed: 2F4813E71EB872E9]

Total time: 2 minutes 14 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestUtilizeNode
[repro]   1/5 failed: org.apache.solr.cloud.ReplaceNodeNoTargetTest
[repro]   1/5 failed: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21531
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21531 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21531/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLowerTerms

Error Message:
Doc with id=5 not found in http://127.0.0.1:36065/forceleader_lower_terms_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=5 not found in http://127.0.0.1:36065/forceleader_lower_terms_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([4EF6BE11D891B6BE:C0C29E52183616CA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:699)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:644)
	at org.apache.solr.cloud.ForceLeaderTest.bringBackOldLeaderAndSendDoc(ForceLeaderTest.java:520)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLowerTerms(ForceLeaderTest.java:158)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12372 lines...]
   [junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
   [junit4]   2> 257859 INFO  (SUITE-ForceLeaderTest-seed#[4EF6BE11D891B6BE]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/init-core-data-001
   [junit4]   2> 257860 WARN  (SUITE-ForceLeaderTest-seed#[4EF6BE11D891B6BE]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=300 numCloses=300
   [junit4]   2> 257860 INFO  (SUITE-ForceLeaderTest-seed#[4EF6BE11D891B6BE]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 257860 INFO  (SUITE-ForceLeaderTest-seed#[4EF6BE11D891B6BE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
   [junit4]   2> 257860 INFO  (SUITE-ForceLeaderTest-seed#[4EF6BE11D891B6BE]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 257862 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 257862 INFO  (Thread-1409) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 257862 INFO  (Thread-1409) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 257867 ERROR (Thread-1409) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 257962 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkTestServer start zk server on port:39045
   [junit4]   2> 257964 INFO  (zkConnectionManagerCallback-339-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 257966 INFO  (zkConnectionManagerCallback-341-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 257968 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 257969 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 257970 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 257971 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 257971 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 257972 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 257972 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 257973 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 257973 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 257974 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 257974 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 257975 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 258071 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 258072 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 258072 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 258072 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 258072 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@74e14163{/,null,AVAILABLE}
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@21a517e6{HTTP/1.1,[http/1.1]}{127.0.0.1:36007}
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server Started @259743ms
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/tempDir-001/control/data, hostPort=40337, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/control-001/cores, replicaType=NRT}
   [junit4]   2> 258074 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 258074 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 258075 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T09:57:59.458990Z
   [junit4]   2> 258076 INFO  (zkConnectionManagerCallback-343-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 258077 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 258077 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/control-001/solr.xml
   [junit4]   2> 258079 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 258079 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 258080 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 258083 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39045/solr
   [junit4]   2> 258084 INFO  (zkConnectionManagerCallback-347-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 258087 INFO  (zkConnectionManagerCallback-349-thread-1-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 258126 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 258126 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40337_
   [junit4]   2> 258127 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.c.Overseer Overseer (id=72209364907720708-127.0.0.1:40337_-n_0000000000) starting
   [junit4]   2> 258131 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40337_
   [junit4]   2> 258132 INFO  (zkCallback-348-thread-1-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 258159 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 258164 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 258164 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 258165 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:40337_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/control-001/cores
   [junit4]   2> 258176 INFO  (zkConnectionManagerCallback-355-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 258177 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 258177 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39045/solr ready
   [junit4]   2> 258178 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=52420,localport=40337], receiveBufferSize:531000
   [junit4]   2> 258179 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36007,localport=58368], receiveBufferSize=530904
   [junit4]   2> 258180 INFO  (qtp1267928255-2680) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40337_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258181 INFO  (OverseerThreadFactory-579-thread-1-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 258284 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=52424,localport=40337], receiveBufferSize:531000
   [junit4]   2> 258285 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36007,localport=58372], receiveBufferSize=530904
   [junit4]   2> 258285 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 258286 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 258389 INFO  (zkCallback-348-thread-1-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 259601 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 259611 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 259705 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 259713 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 259714 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 259714 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 259714 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 259716 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=652961202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 259718 WARN  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 259745 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 259745 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 259745 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 259745 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 259746 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4279769623972459]
   [junit4]   2> 259746 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35de8389[control_collection_shard1_replica_n1] main]
   [junit4]   2> 259747 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 259747 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 259748 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 259748 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593366472170668032
   [junit4]   2> 259749 INFO  (searcherExecutor-582-thread-1-processing-n:127.0.0.1:40337_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@35de8389[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40337/control_collection_shard1_replica_n1/
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:40337/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 259752 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 259754 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40337/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 259855 INFO  (zkCallback-348-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 259905 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 259906 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1621
   [junit4]   2> 259909 INFO  (qtp1267928255-2680) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 260007 INFO  (zkCallback-348-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 260183 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 260909 INFO  (qtp1267928255-2680) [n:127.0.0.1:40337_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40337_&wt=javabin&version=2} status=0 QTime=2729
   [junit4]   2> 260919 INFO  (zkConnectionManagerCallback-359-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 260920 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 260920 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39045/solr ready
   [junit4]   2> 260920 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 260921 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=52472,localport=40337], receiveBufferSize:531000
   [junit4]   2> 260921 INFO  (SocketProxy-Acceptor-40337) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36007,localport=58420], receiveBufferSize=530904
   [junit4]   2> 260922 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 260923 INFO  (OverseerThreadFactory-579-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 260924 WARN  (OverseerThreadFactory-579-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 261127 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 261127 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 261190 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001 of type NRT
   [junit4]   2> 261190 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 261191 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 261191 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 261191 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 261191 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a685e3f{/,null,AVAILABLE}
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3ba96607{HTTP/1.1,[http/1.1]}{127.0.0.1:37209}
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server Started @262861ms
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/tempDir-001/jetty1, hostPort=35543, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001/cores, replicaType=NRT}
   [junit4]   2> 261192 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 261192 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T09:58:02.576715Z
   [junit4]   2> 261194 INFO  (zkConnectionManagerCallback-361-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 261194 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 261194 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001/solr.xml
   [junit4]   2> 261196 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 261196 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 261197 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 261198 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39045/solr
   [junit4]   2> 261199 INFO  (zkConnectionManagerCallback-365-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 261202 INFO  (zkConnectionManagerCallback-367-thread-1-processing-n:127.0.0.1:35543_) [n:127.0.0.1:35543_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 261205 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 261206 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 261207 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35543_
   [junit4]   2> 261207 INFO  (zkCallback-358-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 261207 INFO  (zkCallback-348-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 261208 INFO  (zkCallback-366-thread-1-processing-n:127.0.0.1:35543_) [n:127.0.0.1:35543_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 261252 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 261261 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 261261 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 261263 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:35543_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001/cores
   [junit4]   2> 261277 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53322,localport=35543], receiveBufferSize:531000
   [junit4]   2> 261278 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37209,localport=50574], receiveBufferSize=530904
   [junit4]   2> 261279 INFO  (qtp72612700-2739) [n:127.0.0.1:35543_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35543_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 261280 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 261280 INFO  (OverseerThreadFactory-579-thread-3-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:35543_ for creating new replica
   [junit4]   2> 261281 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53326,localport=35543], receiveBufferSize:531000
   [junit4]   2> 261282 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37209,localport=50578], receiveBufferSize=530904
   [junit4]   2> 261286 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 261287 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 262363 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 262370 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 262427 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 262436 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 262437 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 262437 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 262437 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 262439 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=652961202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 262440 WARN  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 262469 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 262469 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 262470 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 262470 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 262471 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4279769623972459]
   [junit4]   2> 262471 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@275b4a20[collection1_shard2_replica_n41] main]
   [junit4]   2> 262472 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 262472 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 262473 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 262474 INFO  (searcherExecutor-593-thread-1-processing-n:127.0.0.1:35543_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@275b4a20[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 262474 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593366475029086208
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35543/collection1_shard2_replica_n41/
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:35543/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 262478 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 262479 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35543/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 262630 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 262632 INFO  (qtp72612700-2769) [n:127.0.0.1:35543_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1345
   [junit4]   2> 262633 INFO  (qtp72612700-2739) [n:127.0.0.1:35543_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35543_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1354
   [junit4]   2> 262741 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001 of type NRT
   [junit4]   2> 262742 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 262743 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 262743 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 262743 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 262743 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@429f2195{/,null,AVAILABLE}
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4ed49c29{HTTP/1.1,[http/1.1]}{127.0.0.1:45033}
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server Started @264412ms
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/tempDir-001/jetty2, hostPort=34613, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001/cores}
   [junit4]   2> 262744 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 262744 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T09:58:04.128782Z
   [junit4]   2> 262746 INFO  (zkConnectionManagerCallback-371-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262747 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 262747 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001/solr.xml
   [junit4]   2> 262748 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 262748 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 262749 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 262751 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39045/solr
   [junit4]   2> 262752 INFO  (zkConnectionManagerCallback-375-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262755 INFO  (zkConnectionManagerCallback-377-thread-1-processing-n:127.0.0.1:34613_) [n:127.0.0.1:34613_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262758 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 262759 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 262759 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34613_
   [junit4]   2> 262760 INFO  (zkCallback-366-thread-1-processing-n:127.0.0.1:35543_) [n:127.0.0.1:35543_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 262760 INFO  (zkCallback-358-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 262760 INFO  (zkCallback-348-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 262761 INFO  (zkCallback-376-thread-1-processing-n:127.0.0.1:34613_) [n:127.0.0.1:34613_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 262802 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 262812 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 262812 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 262814 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:34613_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001/cores
   [junit4]   2> 262843 INFO  (SocketProxy-Acceptor-34613) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43960,localport=34613], receiveBufferSize:531000
   [junit4]   2> 262843 INFO  (SocketProxy-Acceptor-34613) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45033,localport=55564], receiveBufferSize=530904
   [junit4]   2> 262844 INFO  (qtp1739735832-2779) [n:127.0.0.1:34613_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34613_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 262845 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 262845 INFO  (OverseerThreadFactory-579-thread-4-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:34613_ for creating new replica
   [junit4]   2> 262846 INFO  (SocketProxy-Acceptor-34613) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43964,localport=34613], receiveBufferSize:531000
   [junit4]   2> 262847 INFO  (SocketProxy-Acceptor-34613) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45033,localport=55568], receiveBufferSize=530904
   [junit4]   2> 262848 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 262848 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 263857 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 263865 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
   [junit4]   2> 263922 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 263929 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
   [junit4]   2> 263930 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 263930 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 263930 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
   [junit4]   2> 263931 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=652961202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 263932 WARN  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 263958 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 263958 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 263959 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 263959 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 263959 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4279769623972459]
   [junit4]   2> 263960 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@76fd16a0[collection1_shard1_replica_n43] main]
   [junit4]   2> 263960 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 263960 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 263961 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 263961 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593366476588318720
   [junit4]   2> 263962 INFO  (searcherExecutor-604-thread-1-processing-n:127.0.0.1:34613_ x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@76fd16a0[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 263964 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 263964 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 263964 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34613/collection1_shard1_replica_n43/
   [junit4]   2> 263965 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 263965 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:34613/collection1_shard1_replica_n43/ has no replicas
   [junit4]   2> 263965 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 263966 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34613/collection1_shard1_replica_n43/ shard1
   [junit4]   2> 264116 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 264118 INFO  (qtp1739735832-2810) [n:127.0.0.1:34613_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1270
   [junit4]   2> 264120 INFO  (qtp1739735832-2779) [n:127.0.0.1:34613_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34613_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1275
   [junit4]   2> 264211 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001 of type NRT
   [junit4]   2> 264211 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 264212 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 264212 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 264212 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 264213 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a21adcf{/,null,AVAILABLE}
   [junit4]   2> 264213 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2d838bda{HTTP/1.1,[http/1.1]}{127.0.0.1:39625}
   [junit4]   2> 264213 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.e.j.s.Server Started @265882ms
   [junit4]   2> 264213 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/tempDir-001/jetty3, hostPort=44857, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001/cores, replicaType=NRT}
   [junit4]   2> 264213 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 264214 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 264214 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 264214 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 264215 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T09:58:05.599004Z
   [junit4]   2> 264216 INFO  (zkConnectionManagerCallback-381-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 264217 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 264217 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001/solr.xml
   [junit4]   2> 264219 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 264219 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 264220 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 264223 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39045/solr
   [junit4]   2> 264227 INFO  (zkConnectionManagerCallback-385-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 264230 INFO  (zkConnectionManagerCallback-387-thread-1-processing-n:127.0.0.1:44857_) [n:127.0.0.1:44857_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 264233 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 264235 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 264236 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44857_
   [junit4]   2> 264236 INFO  (zkCallback-376-thread-1-processing-n:127.0.0.1:34613_) [n:127.0.0.1:34613_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 264236 INFO  (zkCallback-366-thread-1-processing-n:127.0.0.1:35543_) [n:127.0.0.1:35543_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 264236 INFO  (zkCallback-358-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 264236 INFO  (zkCallback-348-thread-2-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 264239 INFO  (zkCallback-386-thread-1-processing-n:127.0.0.1:44857_) [n:127.0.0.1:44857_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 264264 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 264270 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 264270 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 264271 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [n:127.0.0.1:44857_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001/cores
   [junit4]   2> 264294 INFO  (qtp1739735832-2783) [n:127.0.0.1:34613_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44857_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 264296 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 264296 INFO  (OverseerThreadFactory-579-thread-5-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44857_ for creating new replica
   [junit4]   2> 264297 INFO  (SocketProxy-Acceptor-44857) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=34708,localport=44857], receiveBufferSize:531000
   [junit4]   2> 264298 INFO  (SocketProxy-Acceptor-44857) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=39625,localport=41408], receiveBufferSize=530904
   [junit4]   2> 264299 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 264299 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 265374 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 265384 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
   [junit4]   2> 265474 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 265483 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
   [junit4]   2> 265483 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2aef1da0
   [junit4]   2> 265484 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 265484 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
   [junit4]   2> 265485 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=652961202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 265487 WARN  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 265513 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 265513 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 265514 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 265514 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 265515 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4279769623972459]
   [junit4]   2> 265515 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@29b0885b[collection1_shard2_replica_n45] main]
   [junit4]   2> 265515 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 265516 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 265516 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 265517 INFO  (searcherExecutor-615-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@29b0885b[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 265517 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593366478219902976
   [junit4]   2> 265520 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45
   [junit4]   2> 265520 INFO  (updateExecutor-382-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 265520 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 265521 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 265521 INFO  (qtp947845708-2819) [n:127.0.0.1:44857_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1222
   [junit4]   2> 265522 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53410,localport=35543], receiveBufferSize:531000
   [junit4]   2> 265522 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37209,localport=50662], receiveBufferSize=530904
   [junit4]   2> 265526 INFO  (qtp1739735832-2783) [n:127.0.0.1:34613_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44857_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1232
   [junit4]   2> 265526 INFO  (qtp72612700-2770) [n:127.0.0.1:35543_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41]  webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 265527 INFO  (qtp72612700-2770) [n:127.0.0.1:35543_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41]  webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 265527 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45]
   [junit4]   2> 265528 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 265528 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:35543/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:44857/collection1_shard2_replica_n45/]
   [junit4]   2> 265530 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLastPublishedStateIsActive
   [junit4]   2> 265530 INFO  (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:44857_ x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:44857_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:35543]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:44857_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 265531 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53414,localport=35543], receiveBufferSize:531000
   [junit4]   2> 265531 INFO  (SocketProxy-Acceptor-35543) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37209,localport=50666], receiveBufferSize=530904
   [junit4]   2> 265533 INFO  (qtp1267928255-2681) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&collection.configName=conf1&name=forceleader_last_published&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 265533 INFO  (qtp72612700-2770) [n:127.0.0.1:35543_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 265534 INFO  (qtp72612700-2770) [n:127.0.0.1:35543_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:44857_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:44857","node_name":"127.0.0.1:44857_","state":"down","type":"NRT"}
   [junit4]   2> 265535 INFO  (OverseerThreadFactory-579-thread-5-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection forceleader_last_published
   [junit4]   2> 265535 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 265535 WARN  (OverseerThreadFactory-579-thread-5-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (forceleader_last_published) without cores.
   [junit4]   2> 265739 INFO  (qtp1267928255-2681) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 265740 INFO  (qtp1267928255-2681) [n:127.0.0.1:40337_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=3&collection.configName=conf1&name=forceleader_last_published&nrtReplicas=3&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=206
   [junit4]   2> 265740 INFO  (qtp1267928255-2686) [n:127.0.0.1:40337_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params property.lirVersion=old&action=ADDREPLICA&collection=forceleader_last_published&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 265741 INFO  (OverseerCollectionConfigSetProcessor-72209364907720708-127.0.0.1:40337_-n_0000000000) [n:127.0.0.1:40337_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 265742 INFO  (OverseerThreadFactory-579-thread-5-processing-n:127.0.0.1:40337_) [n:127.0.0.1:40337_    ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44857_ for creating new replica
   [junit4]   2> 265744 INFO  (qtp947845708-2823) [n:127.0.0.1:44857_    ] o.a.s.h.a

[...truncated too long message...]

Handle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 408870 INFO  (qtp205752527-3600) [n:127.0.0.1:40119_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:36065_&onlyIfLeaderActive=true&core=forceleader_lower_terms_collection_shard1_replica_n2&coreNodeName=core_node5&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=1001
   [junit4]   2> 408871 ERROR (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 408871 INFO  (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45635 45635
   [junit4]   2> 414736 INFO  (Thread-1528) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45635 45635
   [junit4]   2> 414737 WARN  (Thread-1528) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	27	/solr/collections/forceleader_lower_terms_collection/terms/shard1
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	6	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	2	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	2	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 	4	/solr/collections/forceleader_lower_terms_collection/state.json
   [junit4]   2> 	3	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72209372693594116-127.0.0.1:36065_-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 	3	/solr/overseer/queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 
   [junit4]   2> 414737 WARN  (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:36627/, target: http://127.0.0.1:41613/
   [junit4]   2> 414737 WARN  (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SocketProxy Closing 21 connections to: http://127.0.0.1:40119/, target: http://127.0.0.1:34493/
   [junit4]   2> 414737 WARN  (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:33783/, target: http://127.0.0.1:42309/
   [junit4]   2> 414737 WARN  (TEST-ForceLeaderTest.testReplicasInLowerTerms-seed#[4EF6BE11D891B6BE]) [    ] o.a.s.c.SocketProxy Closing 8 connections to: http://127.0.0.1:36065/, target: http://127.0.0.1:42611/
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ForceLeaderTest -Dtests.method=testReplicasInLowerTerms -Dtests.seed=4EF6BE11D891B6BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GA -Dtests.timezone=Africa/El_Aaiun -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 38.1s J2 | ForceLeaderTest.testReplicasInLowerTerms <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=5 not found in http://127.0.0.1:36065/forceleader_lower_terms_collection due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4EF6BE11D891B6BE:C0C29E52183616CA]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:699)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:644)
   [junit4]    > 	at org.apache.solr.cloud.ForceLeaderTest.bringBackOldLeaderAndSendDoc(ForceLeaderTest.java:520)
   [junit4]    > 	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLowerTerms(ForceLeaderTest.java:158)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ForceLeaderTest_4EF6BE11D891B6BE-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@21bd6263), locale=fr-GA, timezone=Africa/El_Aaiun
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=185644808,total=468713472
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudDeleteByQuery, SolrIndexMetricsTest, TestStressInPlaceUpdates, TestPerFieldSimilarityWithDefaultOverride, TestMinMaxOnMultiValuedField, PingRequestHandlerTest, HdfsBasicDistributedZk2Test, LargeFieldTest, HdfsDirectoryFactoryTest, DistributedQueryComponentOptimizationTest, TestFileDictionaryLookup, TestHdfsUpdateLog, TestClassicSimilarityFactory, SpatialFilterTest, PeerSyncReplicationTest, TestUseDocValuesAsStored, ForceLeaderTest]
   [junit4] Completed [92/778 (1!)] on J2 in 156.90s, 4 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 43540 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21531/consoleText

[repro] Revision: b212f2e9b7b5d20ab8d6168b5ddcb164f536d1af

[repro] Repro line:  ant test  -Dtestcase=ForceLeaderTest -Dtests.method=testReplicasInLowerTerms -Dtests.seed=4EF6BE11D891B6BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GA -Dtests.timezone=Africa/El_Aaiun -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       ForceLeaderTest
[repro] ant compile-test

[...truncated 3297 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ForceLeaderTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=4EF6BE11D891B6BE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-GA -Dtests.timezone=Africa/El_Aaiun -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 91 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.ForceLeaderTest
[repro] Exiting with code 0

[...truncated 40 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_162) - Build # 21530 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21530/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

No tests ran.

Build Log:
[...truncated 63141 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21530/consoleText

[repro] Revision: 29e5b8abcee8a566cc057b862ab99c5ffef13a76

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] No "reproduce with" lines found; exiting.

[...truncated 8 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build # 21529 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21529/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLowerTerms

Error Message:
Doc with id=5 not found in http://127.0.0.1:37255/qh_/b/forceleader_lower_terms_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=5 not found in http://127.0.0.1:37255/qh_/b/forceleader_lower_terms_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([696973180566E405:E75D535BC5C14471]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:699)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:644)
	at org.apache.solr.cloud.ForceLeaderTest.bringBackOldLeaderAndSendDoc(ForceLeaderTest.java:520)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLowerTerms(ForceLeaderTest.java:158)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([696973180566E405:D36544975A8E324A]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.junit.Assert.assertNull(Assert.java:562)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1589)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12558 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/init-core-data-001
   [junit4]   2> 358095 WARN  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
   [junit4]   2> 358095 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 358096 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 358096 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 358097 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001
   [junit4]   2> 358097 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 358098 INFO  (Thread-1332) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 358098 INFO  (Thread-1332) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 358099 ERROR (Thread-1332) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 358198 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:43487
   [junit4]   2> 358199 INFO  (zkConnectionManagerCallback-527-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358203 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 358203 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64bc2fc8{/solr,null,AVAILABLE}
   [junit4]   2> 358206 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a677be{/solr,null,AVAILABLE}
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1e49f304{SSL,[ssl, http/1.1]}{127.0.0.1:45913}
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@c02c095{SSL,[ssl, http/1.1]}{127.0.0.1:43189}
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.e.j.s.Server Started @360131ms
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.e.j.s.Server Started @360131ms
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45913}
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43189}
   [junit4]   2> 358208 ERROR (jetty-launcher-524-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 358208 ERROR (jetty-launcher-524-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T03:02:21.609404Z
   [junit4]   2> 358208 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T03:02:21.609413Z
   [junit4]   2> 358209 INFO  (zkConnectionManagerCallback-531-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358209 INFO  (zkConnectionManagerCallback-530-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358209 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 358209 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 358217 INFO  (jetty-launcher-524-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43487/solr
   [junit4]   2> 358217 INFO  (jetty-launcher-524-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43487/solr
   [junit4]   2> 358219 INFO  (zkConnectionManagerCallback-539-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358219 INFO  (zkConnectionManagerCallback-537-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358220 INFO  (zkConnectionManagerCallback-542-thread-1-processing-n:127.0.0.1:43189_solr) [n:127.0.0.1:43189_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358220 INFO  (zkConnectionManagerCallback-543-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358256 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 358256 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 358256 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43189_solr
   [junit4]   2> 358257 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45913_solr
   [junit4]   2> 358257 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.c.Overseer Overseer (id=72207730587271173-127.0.0.1:43189_solr-n_0000000000) starting
   [junit4]   2> 358262 INFO  (zkCallback-540-thread-1-processing-n:127.0.0.1:43189_solr) [n:127.0.0.1:43189_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 358262 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 358265 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 358266 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 358266 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43189_solr
   [junit4]   2> 358266 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:45913_solr]
   [junit4]   2> 358266 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 358266 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 358266 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 358266 INFO  (zkCallback-540-thread-1-processing-n:127.0.0.1:43189_solr) [n:127.0.0.1:43189_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 358269 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 358269 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 358269 DEBUG (ScheduledTrigger-1065-thread-1) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 358294 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45913.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358300 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45913.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358300 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45913.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358301 INFO  (jetty-launcher-524-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001/node1/.
   [junit4]   2> 358305 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43189.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358319 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43189.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358319 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43189.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 358320 INFO  (jetty-launcher-524-thread-2) [n:127.0.0.1:43189_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001/node2/.
   [junit4]   2> 358342 INFO  (zkConnectionManagerCallback-549-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358345 INFO  (zkConnectionManagerCallback-553-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 358345 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 358345 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43487/solr ready
   [junit4]   2> 358352 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeMarkersRegistration
   [junit4]   2> 358363 INFO  (qtp36039608-3537) [n:127.0.0.1:43189_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 358367 INFO  (qtp36039608-3537) [n:127.0.0.1:43189_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 358367 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 358368 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 358369 DEBUG (zkCallback-540-thread-1-processing-n:127.0.0.1:43189_solr) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 358369 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 358369 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 358369 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 358369 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 358369 DEBUG (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 358370 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@c02c095{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 358370 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1801020807
   [junit4]   2> 358370 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 358370 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1eda6e1a: rootName = solr_43189, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@beed652
   [junit4]   2> 358375 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 358375 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3061e44a: rootName = solr_43189, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@59fe4169
   [junit4]   2> 358377 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 358377 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a5043c7: rootName = solr_43189, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4ff50bd7
   [junit4]   2> 358379 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43189_solr
   [junit4]   2> 358380 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 358380 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 358380 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 358380 INFO  (zkCallback-540-thread-1-processing-n:127.0.0.1:43189_solr) [n:127.0.0.1:43189_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 358380 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.Overseer Overseer (id=72207730587271173-127.0.0.1:43189_solr-n_0000000000) closing
   [junit4]   2> 358380 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 358380 INFO  (OverseerStateUpdate-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43189_solr
   [junit4]   2> 358380 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 358380 WARN  (OverseerAutoScalingTriggerThread-72207730587271173-127.0.0.1:43189_solr-n_0000000000) [n:127.0.0.1:43189_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 358380 DEBUG (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 358381 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45913_solr
   [junit4]   2> 358381 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a677be{/solr,null,UNAVAILABLE}
   [junit4]   2> 358381 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 358381 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.Overseer Overseer (id=72207730587271174-127.0.0.1:45913_solr-n_0000000001) starting
   [junit4]   2> 358383 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 358383 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 358383 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:45913_solr]
   [junit4]   2> 358383 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
   [junit4]   2> 358383 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 358384 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 358384 DEBUG (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 358384 DEBUG (ScheduledTrigger-1074-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 359385 DEBUG (ScheduledTrigger-1074-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 360385 DEBUG (ScheduledTrigger-1074-thread-2) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 361385 DEBUG (ScheduledTrigger-1074-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 362385 DEBUG (ScheduledTrigger-1074-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 363383 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 363383 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 363384 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 363384 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 363384 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d8ebc7c{/solr,null,AVAILABLE}
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2d6ab05a{SSL,[ssl, http/1.1]}{127.0.0.1:38113}
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server Started @365308ms
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38113}
   [junit4]   2> 363385 ERROR (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 363385 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T03:02:26.786864Z
   [junit4]   2> 363385 DEBUG (ScheduledTrigger-1074-thread-1) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 363388 INFO  (zkConnectionManagerCallback-556-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363389 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 363395 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43487/solr
   [junit4]   2> 363396 INFO  (zkConnectionManagerCallback-560-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363398 INFO  (zkConnectionManagerCallback-562-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363400 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 363401 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 363402 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38113_solr
   [junit4]   2> 363403 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 363403 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 363403 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 363405 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 363443 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38113.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363449 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38113.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363449 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38113.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363450 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:38113_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001/node3/.
   [junit4]   2> 363477 INFO  (qtp508465927-3600) [n:127.0.0.1:38113_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 363480 INFO  (qtp508465927-3600) [n:127.0.0.1:38113_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 363482 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5dbba759{/solr,null,AVAILABLE}
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69569d57{SSL,[ssl, http/1.1]}{127.0.0.1:33565}
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server Started @365407ms
   [junit4]   2> 363483 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33565}
   [junit4]   2> 363484 ERROR (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 363484 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 363484 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 363484 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 363484 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T03:02:26.885193Z
   [junit4]   2> 363485 INFO  (zkConnectionManagerCallback-566-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363485 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 363489 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43487/solr
   [junit4]   2> 363492 INFO  (zkConnectionManagerCallback-570-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363494 INFO  (zkConnectionManagerCallback-572-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 363496 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 363497 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 363498 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33565_solr
   [junit4]   2> 363498 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 363498 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 363498 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 363498 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 363502 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 363531 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33565.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363537 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33565.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363538 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33565.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 363538 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:33565_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001/node4/.
   [junit4]   2> 363574 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest ====== KILL OVERSEER 1
   [junit4]   2> 363575 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1e49f304{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 363575 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=482389580
   [junit4]   2> 363575 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 363575 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@557bc3e9: rootName = solr_45913, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@45f8f039
   [junit4]   2> 363583 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 363583 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@25e822db: rootName = solr_45913, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@59fe4169
   [junit4]   2> 363588 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 363588 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@185d8b9b: rootName = solr_45913, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4ff50bd7
   [junit4]   2> 363589 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45913_solr
   [junit4]   2> 363590 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 363590 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 363590 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 363590 INFO  (zkCallback-541-thread-1-processing-n:127.0.0.1:45913_solr) [n:127.0.0.1:45913_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 363590 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 363590 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 363590 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 363590 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.Overseer Overseer (id=72207730587271174-127.0.0.1:45913_solr-n_0000000001) closing
   [junit4]   2> 363590 INFO  (OverseerStateUpdate-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45913_solr
   [junit4]   2> 363590 WARN  (OverseerAutoScalingTriggerThread-72207730587271174-127.0.0.1:45913_solr-n_0000000001) [n:127.0.0.1:45913_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 363591 DEBUG (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 363592 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38113_solr
   [junit4]   2> 363592 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64bc2fc8{/solr,null,UNAVAILABLE}
   [junit4]   2> 363592 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 363592 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.Overseer Overseer (id=72207730587271179-127.0.0.1:38113_solr-n_0000000002) starting
   [junit4]   2> 363595 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 363595 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 363595 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
   [junit4]   2> 363595 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 363595 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Adding lost node from marker path: 127.0.0.1:45913_solr
   [junit4]   2> 363596 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 363596 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 363596 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 364596 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 365597 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 366597 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 367597 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 368593 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest ====== ADD TRIGGERS
   [junit4]   2> 368598 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 368605 INFO  (qtp1705530624-3628) [n:127.0.0.1:33565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 368608 INFO  (qtp508465927-3596) [n:127.0.0.1:38113_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 368609 DEBUG (qtp508465927-3602) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 368609 INFO  (qtp508465927-3602) [n:127.0.0.1:38113_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=14
   [junit4]   2> 368609 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 368611 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 368611 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerMR instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestEventMarkerAction}], enabled=true}
   [junit4]   2> 368612 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 368612 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 368613 INFO  (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.TriggerIntegrationTest TestEventMarkerAction init
   [junit4]   2> 368614 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 368614 DEBUG (ScheduledTrigger-1091-thread-3) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerMR
   [junit4]   2> 368614 DEBUG (ScheduledTrigger-1091-thread-3) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 368620 INFO  (qtp1705530624-3624) [n:127.0.0.1:33565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 368624 INFO  (qtp508465927-3596) [n:127.0.0.1:38113_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 368624 DEBUG (qtp1705530624-3627) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 368625 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 368625 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 368625 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 368625 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerMR instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestEventMarkerAction}], enabled=true}
   [junit4]   2> 368626 DEBUG (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:38113_solr]
   [junit4]   2> 368626 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 368626 INFO  (qtp1705530624-3627) [n:127.0.0.1:33565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=14
   [junit4]   2> 368627 INFO  (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.TriggerIntegrationTest TestEventMarkerAction init
   [junit4]   2> 368627 INFO  (qtp1705530624-3627) [n:127.0.0.1:33565_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 368627 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_triggerMR with currently live nodes: 2
   [junit4]   2> 368627 DEBUG (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 368631 INFO  (qtp1705530624-3627) [n:127.0.0.1:33565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 368632 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest ====== ADD NODE 1
   [junit4]   2> 368633 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 368638 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 368638 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 368638 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 368638 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35a6fb31{/solr,null,AVAILABLE}
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@40025b1c{SSL,[ssl, http/1.1]}{127.0.0.1:36295}
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.Server Started @370562ms
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36295}
   [junit4]   2> 368639 ERROR (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 368639 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-25T03:02:32.040812Z
   [junit4]   2> 368640 INFO  (zkConnectionManagerCallback-576-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 368641 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 368646 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43487/solr
   [junit4]   2> 368649 INFO  (zkConnectionManagerCallback-580-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 368652 INFO  (zkConnectionManagerCallback-582-thread-1-processing-n:127.0.0.1:36295_solr) [n:127.0.0.1:36295_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 368654 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 368655 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 368656 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36295_solr
   [junit4]   2> 368657 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 368657 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 368657 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 368657 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 368658 INFO  (zkCallback-581-thread-1-processing-n:127.0.0.1:36295_solr) [n:127.0.0.1:36295_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 368691 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36295.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 368700 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36295.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 368701 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36295.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e817342
   [junit4]   2> 368702 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [n:127.0.0.1:36295_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001/tempDir-001/node5/.
   [junit4]   2> 369598 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 369615 DEBUG (ScheduledTrigger-1091-thread-4) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerMR
   [junit4]   2> 369615 DEBUG (ScheduledTrigger-1091-thread-4) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 369615 DEBUG (ScheduledTrigger-1091-thread-4) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:36295_solr at time 2290913454214027
   [junit4]   2> 369628 DEBUG (ScheduledTrigger-1091-thread-3) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_triggerMR with currently live nodes: 3
   [junit4]   2> 370599 DEBUG (ScheduledTrigger-1091-thread-1) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 370616 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerMR
   [junit4]   2> 370616 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 370616 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerMR firing registered processor for nodes: [127.0.0.1:36295_solr] added at times [2290913454214027], now=2290914455053671
   [junit4]   2> 370616 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"82392daa64b8bT76kr4uopgh5dy8llaxuoy1cvf",
   [junit4]   2>   "source":"node_added_triggerMR",
   [junit4]   2>   "eventTime":2290913454214027,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2290913454214027],
   [junit4]   2>     "nodeNames":["127.0.0.1:36295_solr"]}}
   [junit4]   2> 370617 DEBUG (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_triggerMR, node_added_triggerMR, .auto_add_replicas]
   [junit4]   2> 370617 INFO  (ScheduledTrigger-1091-thread-2) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 370618 DEBUG (AutoscalingActionExecutor-1092-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"82392daa64b8bT76kr4uopgh5dy8llaxuoy1cvf",
   [junit4]   2>   "source":"node_added_triggerMR",
   [junit4]   2>   "eventTime":2290913454214027,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2290913454214027],
   [junit4]   2>     "_enqueue_time_":2290914455635462,
   [junit4]   2>     "nodeNames":["127.0.0.1:36295_solr"]}}
   [junit4]   2> 370618 DEBUG (AutoscalingActionExecutor-1092-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_triggerMR after 5000ms
   [junit4]   2> 370618 DEBUG (AutoscalingActionExecutor-1092-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerMR after 5000ms
   [junit4]   2> 370618 DEBUG (AutoscalingActionExecutor-1092-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 370618 DEBUG (AutoscalingActionExecutor-1092-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=82392daa64b8bT76kr4uopgh5dy8llaxuoy1cvf
   [junit4]   2> 370630 INFO  (OverseerCollectionConfigSetProcessor-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 373724 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest ====== KILL OVERSEER 2
   [junit4]   2> 373725 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@2d6ab05a{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 373725 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=236420582
   [junit4]   2> 373725 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 373725 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3fa6e660: rootName = solr_38113, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3a86a1d5
   [junit4]   2> 373733 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 373733 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@534f0658: rootName = solr_38113, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@59fe4169
   [junit4]   2> 373737 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 373737 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@32224da1: rootName = solr_38113, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4ff50bd7
   [junit4]   2> 373738 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38113_solr
   [junit4]   2> 373739 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 373739 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 373739 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 373739 INFO  (zkCallback-561-thread-1-processing-n:127.0.0.1:38113_solr) [n:127.0.0.1:38113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 373739 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 373739 INFO  (zkCallback-581-thread-1-processing-n:127.0.0.1:36295_solr) [n:127.0.0.1:36295_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 373739 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.Overseer Overseer (id=72207730587271179-127.0.0.1:38113_solr-n_0000000002) closing
   [junit4]   2> 373739 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 373740 INFO  (OverseerStateUpdate-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38113_solr
   [junit4]   2> 373740 WARN  (OverseerAutoScalingTriggerThread-72207730587271179-127.0.0.1:38113_solr-n_0000000002) [n:127.0.0.1:38113_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 373740 DEBUG (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 373741 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2d8ebc7c{/solr,null,UNAVAILABLE}
   [junit4]   2> 373741 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33565_solr
   [junit4]   2> 373741 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 373742 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.Overseer Overseer (id=72207730587271182-127.0.0.1:33565_solr-n_0000000003) starting
   [junit4]   2> 373743 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 373743 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:36295_solr]
   [junit4]   2> 373743 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:36295_solr]
   [junit4]   2> 373743 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerMR instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestEventMarkerAction}], enabled=true}
   [junit4]   2> 373743 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33565_solr, 127.0.0.1:36295_solr]
   [junit4]   2> 373744 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion -1
   [junit4]   2> 373744 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 373744 INFO  (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.TriggerIntegrationTest TestEventMarkerAction init
   [junit4]   2> 373744 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Adding lost node from marker path: 127.0.0.1:38113_solr
   [junit4]   2> 373744 INFO  (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.TriggerIntegrationTest TestEventMarkerAction init
   [junit4]   2> 373744 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_triggerMR with currently live nodes: 2
   [junit4]   2> 373744 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:38113_solr
   [junit4]   2> 373744 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 373744 DEBUG (ScheduledTrigger-1102-thread-2) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerMR
   [junit4]   2> 373744 DEBUG (ScheduledTrigger-1102-thread-2) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 373745 DEBUG (ScheduledTrigger-1102-thread-3) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 373745 DEBUG (ScheduledTrigger-1102-thread-3) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:38113_solr
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_triggerMR with currently live nodes: 2
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:38113_solr]
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"82393d0c27900T76kr4uopgh5dy8llaxuoy1cvh",
   [junit4]   2>   "source":"node_lost_triggerMR",
   [junit4]   2>   "eventTime":2290917583255808,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2290917583255808],
   [junit4]   2>     "nodeNames":["127.0.0.1:38113_solr"]}}
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-4) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerMR
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_triggerMR, node_added_triggerMR, .auto_add_replicas]
   [junit4]   2> 374745 DEBUG (ScheduledTrigger-1102-thread-4) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 374746 INFO  (ScheduledTrigger-1102-thread-1) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 374746 DEBUG (AutoscalingActionExecutor-1103-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"82393d0c27900T76kr4uopgh5dy8llaxuoy1cvh",
   [junit4]   2>   "source":"node_lost_triggerMR",
   [junit4]   2>   "eventTime":2290917583255808,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2290917583255808],
   [junit4]   2>     "_enqueue_time_":2290918584285888,
   [junit4]   2>     "nodeNames":["127.0.0.1:38113_solr"]}}
   [junit4]   2> 374746 INFO  (TEST-TriggerIntegrationTest.testNodeMarkersRegistration-seed#[696973180566E405]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeMarkersRegistration
   [junit4]   2> 374747 DEBUG (AutoscalingActionExecutor-1103-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_triggerMR after 5000ms
   [junit4]   2> 374747 DEBUG (AutoscalingActionExecutor-1103-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerMR after 5000ms
   [junit4]   2> 374747 DEBUG (AutoscalingActionExecutor-1103-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 374747 DEBUG (AutoscalingActionExecutor-1103-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=82393d0c27900T76kr4uopgh5dy8llaxuoy1cvh
   [junit4]   2> 374754 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
   [junit4]   2> 374756 INFO  (qtp1705530624-3628) [n:127.0.0.1:33565_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 374758 INFO  (qtp1705530624-3628) [n:127.0.0.1:33565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 374758 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_triggerMR
   [junit4]   2> 374759 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_triggerMR
   [junit4]   2> 374759 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 374760 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 6
   [junit4]   2> 374760 DEBUG (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 374760 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 374760 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 374760 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 374760 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 374760 DEBUG (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 374761 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@69569d57{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 374761 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1523181548
   [junit4]   2> 374761 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 374761 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d1ec696: rootName = solr_33565, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@8146bbf
   [junit4]   2> 374768 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 374768 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@254d7549: rootName = solr_33565, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@59fe4169
   [junit4]   2> 374772 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 374772 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5327cec3: rootName = solr_33565, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4ff50bd7
   [junit4]   2> 374773 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33565_solr
   [junit4]   2> 374773 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 374774 INFO  (zkCallback-552-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 374774 INFO  (zkCallback-571-thread-1-processing-n:127.0.0.1:33565_solr) [n:127.0.0.1:33565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 374774 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 374774 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 374774 INFO  (zkCallback-581-thread-1-processing-n:127.0.0.1:36295_solr) [n:127.0.0.1:36295_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 374774 INFO  (zkCallback-552-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 374774 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.Overseer Overseer (id=72207730587271182-127.0.0.1:33565_solr-n_0000000003) closing
   [junit4]   2> 374774 INFO  (OverseerStateUpdate-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33565_solr
   [junit4]   2> 374774 WARN  (OverseerAutoScalingTriggerThread-72207730587271182-127.0.0.1:33565_solr-n_0000000003) [n:127.0.0.1:33565_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 374774 DEBUG (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[696973180566E405]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 374775 INFO  (zkCallback-581-thread-1-processing-n:127.0.0.1:36295_solr) [n:127.0.0.1:36295_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36295_solr
   [junit4]   2> 374775 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTri

[...truncated too long message...]

  2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:704)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:703)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$900(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1090)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1085)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 575187 WARN  (zkCallback-618-thread-2-processing-n:127.0.0.1:44951_solr) [n:127.0.0.1:44951_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:44783_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:44783_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:704)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:703)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$900(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1090)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1085)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 575187 INFO  (jetty-closer-333-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4383720a{/solr,null,UNAVAILABLE}
   [junit4]   2> 575187 INFO  (jetty-closer-333-thread-4) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 575188 ERROR (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 575188 INFO  (SUITE-TriggerIntegrationTest-seed#[696973180566E405]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45299 45299
   [junit4]   2> 581070 INFO  (Thread-337) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45299 45299
   [junit4]   2> 581071 WARN  (Thread-337) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	45	/solr/aliases.json
   [junit4]   2> 	32	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	30	/solr/security.json
   [junit4]   2> 	12	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	9	/solr/configs/conf
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	47	/solr/collections/collection1/state.json
   [junit4]   2> 	45	/solr/clusterprops.json
   [junit4]   2> 	45	/solr/clusterstate.json
   [junit4]   2> 	37	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	20	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72207941738889272-127.0.0.1:45579_solr-n_0000000017
   [junit4]   2> 	2	/solr/overseer_elect/election/72207941738889297-127.0.0.1:44951_solr-n_0000000025
   [junit4]   2> 	2	/solr/overseer_elect/election/72207941738889291-127.0.0.1:33057_solr-n_0000000023
   [junit4]   2> 	2	/solr/overseer_elect/election/72207941738889251-127.0.0.1:36107_solr-n_0000000010
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	414	/solr/live_nodes
   [junit4]   2> 	87	/solr/collections
   [junit4]   2> 	20	/solr/overseer/queue-work
   [junit4]   2> 	20	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	20	/solr/overseer/queue
   [junit4]   2> 	20	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_696973180566E405-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=MockRandom), x_s=Lucene50(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=252, maxMBSortInHeap=7.743580826767908, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7b4a75eb), locale=kn-IN, timezone=America/Indiana/Petersburg
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=265530552,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TriggerIntegrationTest]
   [junit4] Completed [6/10 (2!)] on J0 in 288.97s, 14 tests, 1 failure <<< FAILURES!

[...truncated 49 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1560: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 90 tests, 2 failures, 5 ignored [seed: 696973180566E405]

Total time: 12 minutes 44 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.ForceLeaderTest
[repro]   2/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=29e5b8abcee8a566cc057b862ab99c5ffef13a76, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21528
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2