You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/03/05 01:53:12 UTC

[JENKINS] Lucene-Solr-6.x-Linux (64bit/jdk1.8.0_121) - Build # 2995 - Failure!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/2995/
Java: 64bit/jdk1.8.0_121 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at https://127.0.0.1:44756/solr/awhollynewcollection_0: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 510 </title> </head> <body> <h2>HTTP ERROR: 510</h2> <p>Problem accessing /solr/awhollynewcollection_0/select. Reason: <pre>    {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg={&quot;awhollynewcollection_0&quot;:7},code=510}</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:44756/solr/awhollynewcollection_0: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 510 </title>
</head>
<body>
<h2>HTTP ERROR: 510</h2>
<p>Problem accessing /solr/awhollynewcollection_0/select. Reason:
<pre>    {metadata={error-class=org.apache.solr.common.SolrException,root-error-class=org.apache.solr.common.SolrException},msg={&quot;awhollynewcollection_0&quot;:7},code=510}</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([6B9F47C57F77ADC0:23EA337179448255]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:578)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1361)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1112)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1215)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1215)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1215)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1215)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1215)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1042)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:522)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12072 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/init-core-data-001
   [junit4]   2> 958151 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 958152 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 958153 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001
   [junit4]   2> 958153 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 958153 INFO  (Thread-1884) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 958154 INFO  (Thread-1884) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 958253 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46758
   [junit4]   2> 958258 INFO  (jetty-launcher-1678-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 958259 INFO  (jetty-launcher-1678-thread-3) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 958259 INFO  (jetty-launcher-1678-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 958259 INFO  (jetty-launcher-1678-thread-4) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 958261 INFO  (jetty-launcher-1678-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c020446{/solr,null,AVAILABLE}
   [junit4]   2> 958261 INFO  (jetty-launcher-1678-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25bbad19{/solr,null,AVAILABLE}
   [junit4]   2> 958261 INFO  (jetty-launcher-1678-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19e0bebb{/solr,null,AVAILABLE}
   [junit4]   2> 958261 INFO  (jetty-launcher-1678-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@220dc019{/solr,null,AVAILABLE}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@76adc0cb{SSL,[ssl, http/1.1]}{127.0.0.1:44728}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2a2f2f0e{SSL,[ssl, http/1.1]}{127.0.0.1:44756}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.e.j.s.Server Started @960500ms
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.e.j.s.Server Started @960500ms
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44728}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44756}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d9c6584{SSL,[ssl, http/1.1]}{127.0.0.1:35565}
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@33291623{SSL,[ssl, http/1.1]}{127.0.0.1:42827}
   [junit4]   2> 958263 ERROR (jetty-launcher-1678-thread-3) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 958263 ERROR (jetty-launcher-1678-thread-4) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.5.0
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.5.0
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-03-05T01:30:11.469Z
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-03-05T01:30:11.470Z
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-1) [    ] o.e.j.s.Server Started @960500ms
   [junit4]   2> 958263 INFO  (jetty-launcher-1678-thread-2) [    ] o.e.j.s.Server Started @960500ms
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42827}
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35565}
   [junit4]   2> 958264 ERROR (jetty-launcher-1678-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 958264 ERROR (jetty-launcher-1678-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.5.0
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.5.0
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-03-05T01:30:11.470Z
   [junit4]   2> 958264 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-03-05T01:30:11.470Z
   [junit4]   2> 958265 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 958266 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 958269 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 958271 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 958273 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 958273 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 958274 INFO  (jetty-launcher-1678-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46758/solr
   [junit4]   2> 958274 INFO  (jetty-launcher-1678-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46758/solr
   [junit4]   2> 958276 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a9c169a200004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 958277 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 958277 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 958278 INFO  (jetty-launcher-1678-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46758/solr
   [junit4]   2> 958278 INFO  (jetty-launcher-1678-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46758/solr
   [junit4]   2> 958290 INFO  (jetty-launcher-1678-thread-3) [n:127.0.0.1:44728_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 958290 INFO  (jetty-launcher-1678-thread-1) [n:127.0.0.1:42827_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 958290 INFO  (jetty-launcher-1678-thread-2) [n:127.0.0.1:35565_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 958290 INFO  (jetty-launcher-1678-thread-4) [n:127.0.0.1:44756_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 958292 INFO  (jetty-launcher-1678-thread-3) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44728_solr
   [junit4]   2> 958292 INFO  (jetty-launcher-1678-thread-2) [n:127.0.0.1:35565_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35565_solr
   [junit4]   2> 958292 INFO  (jetty-launcher-1678-thread-1) [n:127.0.0.1:42827_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42827_solr
   [junit4]   2> 958292 INFO  (jetty-launcher-1678-thread-4) [n:127.0.0.1:44756_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44756_solr
   [junit4]   2> 958292 INFO  (jetty-launcher-1678-thread-3) [n:127.0.0.1:44728_solr    ] o.a.s.c.Overseer Overseer (id=97561962830888972-127.0.0.1:44728_solr-n_0000000000) starting
   [junit4]   2> 958293 INFO  (zkCallback-1691-thread-1-processing-n:127.0.0.1:42827_solr) [n:127.0.0.1:42827_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 958293 INFO  (zkCallback-1700-thread-1-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 958293 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 958293 INFO  (zkCallback-1699-thread-1-processing-n:127.0.0.1:35565_solr) [n:127.0.0.1:35565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 958297 INFO  (jetty-launcher-1678-thread-3) [n:127.0.0.1:44728_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44728_solr
   [junit4]   2> 958298 INFO  (zkCallback-1699-thread-1-processing-n:127.0.0.1:35565_solr) [n:127.0.0.1:35565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 958298 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 958298 INFO  (zkCallback-1691-thread-1-processing-n:127.0.0.1:42827_solr) [n:127.0.0.1:42827_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 958298 INFO  (zkCallback-1700-thread-1-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 958360 INFO  (jetty-launcher-1678-thread-2) [n:127.0.0.1:35565_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node2/.
   [junit4]   2> 958384 INFO  (jetty-launcher-1678-thread-3) [n:127.0.0.1:44728_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node3/.
   [junit4]   2> 958385 INFO  (jetty-launcher-1678-thread-4) [n:127.0.0.1:44756_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node4/.
   [junit4]   2> 958424 INFO  (jetty-launcher-1678-thread-1) [n:127.0.0.1:42827_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node1/.
   [junit4]   2> 958597 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 958597 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46758/solr ready
   [junit4]   2> 958615 INFO  (TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteNonExistentCollection
   [junit4]   2> 958615 INFO  (TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 958671 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=unknown_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 958672 INFO  (OverseerThreadFactory-3640-thread-1-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 958673 ERROR (OverseerThreadFactory-3640-thread-1-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: unknown_collection operation: delete failed:org.apache.solr.common.SolrException: Could not find collection : unknown_collection
   [junit4]   2> 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.collectionCmd(OverseerCollectionMessageHandler.java:843)
   [junit4]   2> 	at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:88)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 958675 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=unknown_collection&action=DELETE&wt=javabin&version=2} status=400 QTime=3
   [junit4]   2> 958676 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=acollectionafterbaddelete&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 958677 INFO  (OverseerThreadFactory-3640-thread-2-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd Create collection acollectionafterbaddelete
   [junit4]   2> 958678 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 958784 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=acollectionafterbaddelete_shard1_replica2&action=CREATE&numShards=1&collection=acollectionafterbaddelete&shard=shard1&wt=javabin&version=2
   [junit4]   2> 958835 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=acollectionafterbaddelete_shard1_replica1&action=CREATE&numShards=1&collection=acollectionafterbaddelete&shard=shard1&wt=javabin&version=2
   [junit4]   2> 958937 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 958937 INFO  (zkCallback-1700-thread-3-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 959791 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 959798 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.s.IndexSchema [acollectionafterbaddelete_shard1_replica2] Schema name=minimal
   [junit4]   2> 959800 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 959801 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'acollectionafterbaddelete_shard1_replica2' using configuration from collection acollectionafterbaddelete
   [junit4]   2> 959801 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.SolrCore [[acollectionafterbaddelete_shard1_replica2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node3/acollectionafterbaddelete_shard1_replica2], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node3/./acollectionafterbaddelete_shard1_replica2/data/]
   [junit4]   2> 959827 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 959827 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 959828 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 959828 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 959828 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@48ab2382[acollectionafterbaddelete_shard1_replica2] main]
   [junit4]   2> 959829 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 959829 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 959829 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 959830 INFO  (searcherExecutor-3649-thread-1-processing-n:127.0.0.1:44728_solr x:acollectionafterbaddelete_shard1_replica2 s:shard1 c:acollectionafterbaddelete) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.SolrCore [acollectionafterbaddelete_shard1_replica2] Registered new searcher Searcher@48ab2382[acollectionafterbaddelete_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 959830 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560991407051636736
   [junit4]   2> 959834 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 959842 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 959848 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.s.IndexSchema [acollectionafterbaddelete_shard1_replica1] Schema name=minimal
   [junit4]   2> 959851 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 959851 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'acollectionafterbaddelete_shard1_replica1' using configuration from collection acollectionafterbaddelete
   [junit4]   2> 959852 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.c.SolrCore [[acollectionafterbaddelete_shard1_replica1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node4/acollectionafterbaddelete_shard1_replica1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node4/./acollectionafterbaddelete_shard1_replica1/data/]
   [junit4]   2> 959883 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 959884 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 959884 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 959884 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 959885 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c74fad4[acollectionafterbaddelete_shard1_replica1] main]
   [junit4]   2> 959885 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 959885 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 959886 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 959886 INFO  (searcherExecutor-3654-thread-1-processing-n:127.0.0.1:44756_solr x:acollectionafterbaddelete_shard1_replica1 s:shard1 c:acollectionafterbaddelete) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.c.SolrCore [acollectionafterbaddelete_shard1_replica1] Registered new searcher Searcher@1c74fad4[acollectionafterbaddelete_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 959886 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560991407110356992
   [junit4]   2> 959935 INFO  (zkCallback-1700-thread-1-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 959935 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960334 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 960334 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 960334 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44728/solr/acollectionafterbaddelete_shard1_replica2/
   [junit4]   2> 960335 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.PeerSync PeerSync: core=acollectionafterbaddelete_shard1_replica2 url=https://127.0.0.1:44728/solr START replicas=[https://127.0.0.1:44756/solr/acollectionafterbaddelete_shard1_replica1/] nUpdates=100
   [junit4]   2> 960335 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.u.PeerSync PeerSync: core=acollectionafterbaddelete_shard1_replica2 url=https://127.0.0.1:44728/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 960339 INFO  (qtp568186341-8986) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1 r:core_node2 x:acollectionafterbaddelete_shard1_replica1] o.a.s.c.S.Request [acollectionafterbaddelete_shard1_replica1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 960340 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 960340 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 960340 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 960342 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44728/solr/acollectionafterbaddelete_shard1_replica2/ shard1
   [junit4]   2> 960443 INFO  (zkCallback-1700-thread-2-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960443 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960492 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 960494 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=acollectionafterbaddelete_shard1_replica2&action=CREATE&numShards=1&collection=acollectionafterbaddelete&shard=shard1&wt=javabin&version=2} status=0 QTime=1711
   [junit4]   2> 960594 INFO  (zkCallback-1700-thread-3-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960594 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960890 INFO  (qtp568186341-8958) [n:127.0.0.1:44756_solr c:acollectionafterbaddelete s:shard1  x:acollectionafterbaddelete_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=acollectionafterbaddelete_shard1_replica1&action=CREATE&numShards=1&collection=acollectionafterbaddelete&shard=shard1&wt=javabin&version=2} status=0 QTime=2055
   [junit4]   2> 960891 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 960991 INFO  (zkCallback-1700-thread-2-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 960991 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 961891 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=acollectionafterbaddelete&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3215
   [junit4]   2> 961893 INFO  (TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteNonExistentCollection
   [junit4]   2> 961910 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateNodeSet
   [junit4]   2> 961910 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 961912 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=acollectionafterbaddelete&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 961913 INFO  (OverseerThreadFactory-3640-thread-3-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 961913 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 961915 INFO  (qtp568186341-8984) [n:127.0.0.1:44756_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.acollectionafterbaddelete.shard1.replica1
   [junit4]   2> 961915 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.acollectionafterbaddelete.shard1.replica2
   [junit4]   2> 961915 INFO  (qtp568186341-8984) [n:127.0.0.1:44756_solr    ] o.a.s.c.SolrCore [acollectionafterbaddelete_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7e27df99
   [junit4]   2> 961916 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.c.SolrCore [acollectionafterbaddelete_shard1_replica2]  CLOSING SolrCore org.apache.solr.core.SolrCore@5c8778b4
   [junit4]   2> 961916 INFO  (qtp568186341-8984) [n:127.0.0.1:44756_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.acollectionafterbaddelete.shard1.replica1
   [junit4]   2> 961917 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.acollectionafterbaddelete.shard1.replica2
   [junit4]   2> 961917 INFO  (qtp568186341-8984) [n:127.0.0.1:44756_solr    ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
   [junit4]   2> 961917 INFO  (qtp568186341-8984) [n:127.0.0.1:44756_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=acollectionafterbaddelete_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 961918 WARN  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 961919 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=acollectionafterbaddelete_shard1_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 962622 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=acollectionafterbaddelete&action=DELETE&wt=javabin&version=2} status=0 QTime=709
   [junit4]   2> 962624 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=nodeset_collection&action=CREATE&numShards=2&createNodeSet=https://127.0.0.1:44756/solr,https://127.0.0.1:44728/solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 962624 INFO  (OverseerThreadFactory-3640-thread-4-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd Create collection nodeset_collection
   [junit4]   2> 962625 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 962625 WARN  (OverseerThreadFactory-3640-thread-4-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (nodeset_collection) without cores.
   [junit4]   2> 962829 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 962829 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=nodeset_collection&action=CREATE&numShards=2&createNodeSet=https://127.0.0.1:44756/solr,https://127.0.0.1:44728/solr&wt=javabin&version=2} status=0 QTime=205
   [junit4]   2> 962831 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreateNodeSet
   [junit4]   2> 962856 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoCollectionSpecified
   [junit4]   2> 962856 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 962858 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=nodeset_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 962860 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 962860 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 963562 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=nodeset_collection&action=DELETE&wt=javabin&version=2} status=0 QTime=703
   [junit4]   2> 963565 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CoreAdminOperation core create command dataDir=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2
   [junit4]   2> 963566 INFO  (OverseerStateUpdate-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 964573 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 964579 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema [corewithnocollection] Schema name=minimal
   [junit4]   2> 964581 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 964582 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.CoreContainer Creating SolrCore 'corewithnocollection' using configuration from collection corewithnocollection
   [junit4]   2> 964583 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore [[corewithnocollection] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node3/corewithnocollection], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002/]
   [junit4]   2> 964607 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 964608 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 964608 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 964608 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 964608 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.s.SolrIndexSearcher Opening [Searcher@141c212b[corewithnocollection] main]
   [junit4]   2> 964609 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 964609 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 964609 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 964609 INFO  (searcherExecutor-3659-thread-1-processing-n:127.0.0.1:44728_solr x:corewithnocollection c:corewithnocollection) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore [corewithnocollection] Registered new searcher Searcher@141c212b[corewithnocollection] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 964609 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560991412062781440
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44728/solr/corewithnocollection/
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy https://127.0.0.1:44728/solr/corewithnocollection/ has no replicas
   [junit4]   2> 964613 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 964614 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44728/solr/corewithnocollection/ shard1
   [junit4]   2> 964765 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 964766 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr c:corewithnocollection   x:corewithnocollection] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={dataDir=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2} status=0 QTime=1201
   [junit4]   2> 964768 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CoreAdminOperation core create command dataDir=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2
   [junit4]   2> 964769 INFO  (OverseerStateUpdate-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 964860 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 965776 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 965783 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema [corewithnocollection2] Schema name=minimal
   [junit4]   2> 965785 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 965786 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.CoreContainer Creating SolrCore 'corewithnocollection2' using configuration from collection corewithnocollection2
   [junit4]   2> 965787 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore [[corewithnocollection2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node3/corewithnocollection2], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002/]
   [junit4]   2> 965814 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 965814 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 965814 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 965814 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 965815 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.SolrIndexSearcher Opening [Searcher@613a0006[corewithnocollection2] main]
   [junit4]   2> 965815 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 965815 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 965816 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 965816 INFO  (searcherExecutor-3664-thread-1-processing-n:127.0.0.1:44728_solr x:corewithnocollection2 c:corewithnocollection2) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore [corewithnocollection2] Registered new searcher Searcher@613a0006[corewithnocollection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 965816 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560991413328412672
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44728/solr/corewithnocollection2/
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy https://127.0.0.1:44728/solr/corewithnocollection2/ has no replicas
   [junit4]   2> 965822 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 965824 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44728/solr/corewithnocollection2/ shard1
   [junit4]   2> 965974 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 965987 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={dataDir=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1218
   [junit4]   2> 965987 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoCollectionSpecified
   [junit4]   2> 966007 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreationAndDeletion
   [junit4]   2> 966008 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 966010 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=corewithnocollection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 966011 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 966013 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.corewithnocollection
   [junit4]   2> 966013 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr    ] o.a.s.c.SolrCore [corewithnocollection]  CLOSING SolrCore org.apache.solr.core.SolrCore@a9c1b8f
   [junit4]   2> 966014 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.corewithnocollection
   [junit4]   2> 966015 INFO  (qtp1172777118-8981) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=corewithnocollection&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 966718 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=corewithnocollection&action=DELETE&wt=javabin&version=2} status=0 QTime=708
   [junit4]   2> 966720 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=corewithnocollection2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 966722 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 966723 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 966725 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.corewithnocollection2
   [junit4]   2> 966726 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.c.SolrCore [corewithnocollection2]  CLOSING SolrCore org.apache.solr.core.SolrCore@7243749e
   [junit4]   2> 966727 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.corewithnocollection2
   [junit4]   2> 966730 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=corewithnocollection2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 967434 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=corewithnocollection2&action=DELETE&wt=javabin&version=2} status=0 QTime=713
   [junit4]   2> 967436 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=created_and_deleted&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 967437 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd Create collection created_and_deleted
   [junit4]   2> 967437 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000012 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 967642 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2
   [junit4]   2> 967745 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 968650 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 968657 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.s.IndexSchema [created_and_deleted_shard1_replica1] Schema name=minimal
   [junit4]   2> 968660 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 968661 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'created_and_deleted_shard1_replica1' using configuration from collection created_and_deleted
   [junit4]   2> 968661 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SolrCore [[created_and_deleted_shard1_replica1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node4/created_and_deleted_shard1_replica1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001/tempDir-001/node4/./created_and_deleted_shard1_replica1/data/]
   [junit4]   2> 968694 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 968694 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 968695 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 968695 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 968696 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@120b6f3f[created_and_deleted_shard1_replica1] main]
   [junit4]   2> 968696 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 968696 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 968696 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 968697 INFO  (searcherExecutor-3669-thread-1-processing-n:127.0.0.1:44756_solr x:created_and_deleted_shard1_replica1 s:shard1 c:created_and_deleted) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SolrCore [created_and_deleted_shard1_replica1] Registered new searcher Searcher@120b6f3f[created_and_deleted_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 968697 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560991416349360128
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44756/solr/created_and_deleted_shard1_replica1/
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.SyncStrategy https://127.0.0.1:44756/solr/created_and_deleted_shard1_replica1/ has no replicas
   [junit4]   2> 968701 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 968703 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44756/solr/created_and_deleted_shard1_replica1/ shard1
   [junit4]   2> 968804 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 968854 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 968866 INFO  (qtp568186341-8965) [n:127.0.0.1:44756_solr c:created_and_deleted s:shard1  x:created_and_deleted_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2} status=0 QTime=1224
   [junit4]   2> 968867 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 968956 INFO  (zkCallback-1694-thread-1-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 969438 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000014 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 969868 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=created_and_deleted&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2432
   [junit4]   2> 969870 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 969870 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 969872 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=created_and_deleted&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 969874 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 969876 INFO  (qtp568186341-8986) [n:127.0.0.1:44756_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.created_and_deleted.shard1.replica1
   [junit4]   2> 969876 INFO  (qtp568186341-8986) [n:127.0.0.1:44756_solr    ] o.a.s.c.SolrCore [created_and_deleted_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5bd6cb94
   [junit4]   2> 969877 INFO  (qtp568186341-8986) [n:127.0.0.1:44756_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.created_and_deleted.shard1.replica1
   [junit4]   2> 969879 INFO  (qtp568186341-8986) [n:127.0.0.1:44756_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=created_and_deleted_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 970583 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=created_and_deleted&action=DELETE&wt=javabin&version=2} status=0 QTime=710
   [junit4]   2> 970585 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970585 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 970585 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreationAndDeletion
   [junit4]   2> 970618 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTooManyReplicas
   [junit4]   2> 970618 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970629 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970635 INFO  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection
   [junit4]   2> 970635 WARN  (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.CreateCollectionCmd Specified replicationFactor of 10 on collection collection is higher than or equal to the number of Solr instances currently live or live and part of your createNodeSet(4). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 970635 ERROR (OverseerThreadFactory-3640-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: collection operation: create failed:org.apache.solr.common.SolrException: Cannot create collection collection. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 4. This allows a maximum of 4 to be created. Value of numShards is 2 and value of replicationFactor is 10. This requires 20 shards to be created (higher than the allowed number)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 970636 INFO  (OverseerCollectionConfigSetProcessor-97561962830888972-127.0.0.1:44728_solr-n_0000000000) [n:127.0.0.1:44728_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000016 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 970638 INFO  (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2} status=400 QTime=9
   [junit4]   2> 970639 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
   [junit4]   2> 970675 INFO  (TEST-CollectionsAPIDistributedZkTest.testMissingRequiredParameters-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMissingRequiredParameters
   [junit4]   2> 970675 INFO  (TEST-CollectionsAPIDistributedZkTest.testMissingRequiredParameters-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970678 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970678 ERROR (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Missing required parameter: name
   [junit4]   2> 	at org.apache.solr.common.params.RequiredSolrParams.getParams(RequiredSolrParams.java:90)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:461)
   [junit4]   2> 	at org.apache.solr.common.params.SolrParams.getAll(SolrParams.java:478)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$0(CollectionsHandler.java:394)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:888)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:226)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:213)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 970679 INFO  (qtp1172777118-8963) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CREATE&numShards=2&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 970679 INFO  (TEST-CollectionsAPIDistributedZkTest.testMissingRequiredParameters-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMissingRequiredParameters
   [junit4]   2> 970722 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 970722 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970726 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=out_of_sync_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970730 INFO  (qtp1172777118-8961) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=out_of_sync_collection&action=DELETE&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 970732 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970732 INFO  (qtp1172777118-8979) [n:127.0.0.1:44728_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 970732 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 970775 INFO  (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBadActionNames
   [junit4]   2> 970775 INFO  (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[6B9F47C57F77ADC0]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970778 ERROR (qtp1172777118-8977) [n:127.0.0.1:44728_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Unknown action: BADACTION
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:208)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]

[...truncated too long message...]

224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1085795 INFO  (qtp1377536778-8960) [n:127.0.0.1:35565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:42827_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica1&coreNodeName=core_node7&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=1001
   [junit4]   2> 1086312 WARN  (zkCallback-1730-thread-5-processing-n:127.0.0.1:44756_solr) [n:127.0.0.1:44756_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1086313 INFO  (jetty-closer-1679-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1086313 INFO  (jetty-closer-1679-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6801b74e{/solr,null,UNAVAILABLE}
   [junit4]   2> 1086318 WARN  (zkCallback-1700-thread-5-processing-n:127.0.0.1:44728_solr) [n:127.0.0.1:44728_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1086318 INFO  (jetty-closer-1679-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1086318 INFO  (jetty-closer-1679-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2c020446{/solr,null,UNAVAILABLE}
   [junit4]   2> 1086319 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46758 46758
   [junit4]   2> 1091333 INFO  (Thread-1884) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46758 46758
   [junit4]   2> 1091334 WARN  (Thread-1884) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	26	/solr/aliases.json
   [junit4]   2> 	23	/solr/configs/conf
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	242	/solr/clusterstate.json
   [junit4]   2> 	26	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/collections/nodes_used_collection/state.json
   [junit4]   2> 	4	/solr/collections/addReplicaColl/state.json
   [junit4]   2> 	4	/solr/collections/reloaded_collection/state.json
   [junit4]   2> 	3	/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2> 	3	/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2> 	2	/solr/collections/onlyinzk/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/97561962830888972-127.0.0.1:44728_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/awhollynewcollection_0/leader_elect/shard1/election/97561962830888967-core_node2-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/97561962830888971-127.0.0.1:35565_solr-n_0000000002
   [junit4]   2> 	2	/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	429	/solr/collections
   [junit4]   2> 	112	/solr/overseer/queue
   [junit4]   2> 	63	/solr/overseer/collection-queue-work
   [junit4]   2> 	59	/solr/live_nodes
   [junit4]   2> 	23	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1091334 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[6B9F47C57F77ADC0]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B9F47C57F77ADC0-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {_version_=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=658, maxMBSortInHeap=5.908158832162261, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=pt-BR, timezone=Asia/Tbilisi
   [junit4]   2> NOTE: Linux 4.4.0-53-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=12,threads=1,free=173780288,total=525336576
   [junit4]   2> NOTE: All tests run in this JVM: [CircularListTest, TestCloudDeleteByQuery, DirectUpdateHandlerTest, TestSolrQueryParserResource, SuggestComponentContextFilterQueryTest, TestOnReconnectListenerSupport, TestMiniSolrCloudCluster, HdfsChaosMonkeyNothingIsSafeTest, TestWriterPerf, TestFreeTextSuggestions, DistributedFacetPivotLongTailTest, RecoveryZkTest, TestXIncludeConfig, TestCustomStream, TestSchemaVersionResource, TestStressInPlaceUpdates, FieldAnalysisRequestHandlerTest, CloudExitableDirectoryReaderTest, DistributedFacetPivotWhiteBoxTest, TestFieldResource, TestPerFieldSimilarityClassic, PluginInfoTest, TestLFUCache, AtomicUpdatesTest, TestSolrFieldCacheMBean, TestDistributedMissingSort, ZkStateWriterTest, AsyncCallRequestStatusResponseTest, JavabinLoaderTest, TestCollapseQParserPlugin, CdcrReplicationDistributedZkTest, TestDynamicFieldCollectionResource, TestHdfsCloudBackupRestore, TestTolerantSearch, FieldMutatingUpdateProcessorTest, TestPKIAuthenticationPlugin, HttpPartitionTest, SuggesterTSTTest, SpatialRPTFieldTypeTest, BinaryUpdateRequestHandlerTest, TestUtils, DOMUtilTest, RankQueryTest, TestExtendedDismaxParser, TestCollectionAPI, FullSolrCloudDistribCmdsTest, TestSort, TestOverriddenPrefixQueryForCustomFieldType, XmlUpdateRequestHandlerTest, DocValuesMultiTest, TestManagedResourceStorage, TestConfigReload, DirectUpdateHandlerOptimizeTest, TestSystemCollAutoCreate, TestCollationField, TestMacros, HdfsLockFactoryTest, LeaderElectionTest, DistributedVersionInfoTest, TestSQLHandlerNonCloud, TestConfigSetProperties, OverseerTest, TestReqParamsAPI, ActionThrottleTest, GraphQueryTest, LukeRequestHandlerTest, CoreAdminRequestStatusTest, RequestHandlersTest, CreateCollectionCleanupTest, CurrencyFieldXmlFileTest, MinimalSchemaTest, OverseerModifyCollectionTest, TestPostingsSolrHighlighter, ResponseLogComponentTest, TestConfigSetsAPIZkFailure, SolrCloudExampleTest, RemoteQueryErrorTest, TestIndexingPerformance, TestDistribDocBasedVersion, TestConfigsApi, SolrMetricManagerTest, RestartWhileUpdatingTest, TestSolrCloudWithKerberosAlt, SimpleFacetsTest, TestConfig, TestEmbeddedSolrServerSchemaAPI, TestSlowCompositeReaderWrapper, TestUseDocValuesAsStored, ReplicaListTransformerTest, TestSolrDynamicMBean, DistributedExpandComponentTest, RulesTest, ExitableDirectoryReaderTest, TestStressReorder, TestGraphTermsQParserPlugin, TestPushWriter, AutoCommitTest, AnalyticsQueryTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrJ, MigrateRouteKeyTest, TestUninvertingReader, TestTolerantUpdateProcessorRandomCloud, TestDefaultStatsCache, BadComponentTest, HdfsTlogReplayBufferedWhileIndexingTest, TestDFRSimilarityFactory, MetricsHandlerTest, TestGroupingSearch, UpdateParamsTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [335/697 (1!)] on J2 in 133.19s, 20 tests, 1 error <<< FAILURES!

[...truncated 12874 lines...]
-validate-source-patterns:
[source-patterns] tabs instead spaces: solr/webapp/web/partials/collections.html

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:775: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:130: Found 1 violations in source files (tabs instead spaces).

Total time: 63 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-6.x-Linux (32bit/jdk1.8.0_121) - Build # 2997 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/2997/
Java: 32bit/jdk1.8.0_121 -client -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 24949 lines...]
-validate-source-patterns:
[source-patterns] tabs instead spaces: solr/webapp/web/partials/collections.html

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:775: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:130: Found 1 violations in source files (tabs instead spaces).

Total time: 71 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-6.x-Linux (64bit/jdk1.8.0_121) - Build # 2996 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/2996/
Java: 64bit/jdk1.8.0_121 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 24948 lines...]
-validate-source-patterns:
[source-patterns] tabs instead spaces: solr/webapp/web/partials/collections.html

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:775: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:130: Found 1 violations in source files (tabs instead spaces).

Total time: 67 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any