You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/02/20 07:29:14 UTC

[JENKINS] Lucene-Solr-BadApples-7.x-Linux (32bit/jdk1.8.0_172) - Build # 164 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-7.x-Linux/164/
Java: 32bit/jdk1.8.0_172 -client -XX:+UseSerialGC

4 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:45141/ftbz/r/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 500 Server Error</title> </head> <body><h2>HTTP ERROR 500</h2> <p>Problem accessing /ftbz/r/collection1/update. Reason: <pre>    Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.AssertionError  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)  at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:158)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)  at org.eclipse.jetty.server.Server.handle(Server.java:502)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)  at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)  at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)  at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)  at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)  at java.lang.Thread.run(Thread.java:748) </pre> <hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45141/ftbz/r/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 500 Server Error</title>
</head>
<body><h2>HTTP ERROR 500</h2>
<p>Problem accessing /ftbz/r/collection1/update. Reason:
<pre>    Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.AssertionError
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)
	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:158)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
	at org.eclipse.jetty.server.Server.handle(Server.java:502)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
	at java.lang.Thread.run(Thread.java:748)
</pre>
<hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([CD114BD41B3EBDD3:4545740EB5C2D02B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:569)
	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:747)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:425)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1075)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1047)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:37057/ftbz/r/collection1: Async exception during distributed update: Error from server at http://127.0.0.1:43729/ftbz/r/collection1_shard1_replica_n2: Can not find: /ftbz/r/collection1_shard1_replica_n2/update    request: http://127.0.0.1:43729/ftbz/r/collection1_shard1_replica_n2/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A37057%2Fftbz%2Fr%2Fcollection1_shard2_replica_n1%2F&wt=javabin&version=2

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37057/ftbz/r/collection1: Async exception during distributed update: Error from server at http://127.0.0.1:43729/ftbz/r/collection1_shard1_replica_n2: Can not find: /ftbz/r/collection1_shard1_replica_n2/update



request: http://127.0.0.1:43729/ftbz/r/collection1_shard1_replica_n2/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A37057%2Fftbz%2Fr%2Fcollection1_shard2_replica_n1%2F&wt=javabin&version=2
	at __randomizedtesting.SeedInfo.seed([CD114BD41B3EBDD3:4545740EB5C2D02B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:569)
	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:747)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:425)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1075)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1047)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:33503/ftbz/r/collection1: Async exception during distributed update: Error from server at http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1: Server Error    request: http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A33503%2Fftbz%2Fr%2Fcollection1_shard2_replica_n5%2F&wt=javabin&version=2 Remote error message: Server error writing document id 68 to the index

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33503/ftbz/r/collection1: Async exception during distributed update: Error from server at http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1: Server Error



request: http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A33503%2Fftbz%2Fr%2Fcollection1_shard2_replica_n5%2F&wt=javabin&version=2
Remote error message: Server error writing document id 68 to the index
	at __randomizedtesting.SeedInfo.seed([CD114BD41B3EBDD3:4545740EB5C2D02B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:569)
	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:747)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:425)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1075)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1047)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:44113/ftbz/r/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 500 Server Error</title> </head> <body><h2>HTTP ERROR 500</h2> <p>Problem accessing /ftbz/r/collection1/update. Reason: <pre>    Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.AssertionError  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)  at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:158)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)  at org.eclipse.jetty.server.Server.handle(Server.java:502)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)  at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)  at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)  at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)  at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)  at java.lang.Thread.run(Thread.java:748) </pre> <hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/>  </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44113/ftbz/r/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 500 Server Error</title>
</head>
<body><h2>HTTP ERROR 500</h2>
<p>Problem accessing /ftbz/r/collection1/update. Reason:
<pre>    Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.AssertionError
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)
	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:158)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
	at org.eclipse.jetty.server.Server.handle(Server.java:502)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
	at java.lang.Thread.run(Thread.java:748)
</pre>
<hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/>

</body>
</html>

	at __randomizedtesting.SeedInfo.seed([CD114BD41B3EBDD3:4545740EB5C2D02B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:569)
	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:747)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:425)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1075)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1047)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13171 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> 896824 INFO  (SUITE-BasicDistributedZkTest-seed#[CD114BD41B3EBDD3]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/init-core-data-001
   [junit4]   2> 896825 WARN  (SUITE-BasicDistributedZkTest-seed#[CD114BD41B3EBDD3]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 896825 INFO  (SUITE-BasicDistributedZkTest-seed#[CD114BD41B3EBDD3]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 896827 INFO  (SUITE-BasicDistributedZkTest-seed#[CD114BD41B3EBDD3]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 896827 INFO  (SUITE-BasicDistributedZkTest-seed#[CD114BD41B3EBDD3]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ftbz/r
   [junit4]   2> 896834 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 896834 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 896834 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 896934 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer start zk server on port:36147
   [junit4]   2> 896935 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:36147
   [junit4]   2> 896935 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 36147
   [junit4]   2> 896938 INFO  (zkConnectionManagerCallback-3380-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 896946 INFO  (zkConnectionManagerCallback-3382-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 896952 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 896954 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 896955 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 896956 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 896957 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 896958 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 896960 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 896961 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 896962 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 896963 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 896964 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 896965 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 897090 WARN  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 897091 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 897094 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f3fd19{/ftbz/r,null,AVAILABLE}
   [junit4]   2> 897098 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@17c18f{HTTP/1.1,[http/1.1]}{127.0.0.1:35895}
   [junit4]   2> 897098 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.e.j.s.Server Started @897129ms
   [junit4]   2> 897098 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/tempDir-001/control/data, replicaType=NRT, hostContext=/ftbz/r, hostPort=35895, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/control-001/cores}
   [junit4]   2> 897098 ERROR (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 897098 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 897099 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.8.0
   [junit4]   2> 897099 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 897099 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 897099 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-20T06:28:13.044Z
   [junit4]   2> 897104 INFO  (zkConnectionManagerCallback-3384-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 897105 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 897106 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/control-001/solr.xml
   [junit4]   2> 897115 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 897115 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 897118 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 899869 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 899877 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36147/solr
   [junit4]   2> 899882 INFO  (zkConnectionManagerCallback-3388-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 899890 INFO  (zkConnectionManagerCallback-3390-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 899966 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35895_ftbz%2Fr
   [junit4]   2> 899967 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.Overseer Overseer (id=72071924809990148-127.0.0.1:35895_ftbz%2Fr-n_0000000000) starting
   [junit4]   2> 899973 INFO  (zkConnectionManagerCallback-3397-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 899975 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36147/solr ready
   [junit4]   2> 899976 INFO  (OverseerStateUpdate-72071924809990148-127.0.0.1:35895_ftbz%2Fr-n_0000000000) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:35895_ftbz%2Fr
   [junit4]   2> 899978 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35895_ftbz%2Fr
   [junit4]   2> 899980 INFO  (zkCallback-3389-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 899983 INFO  (zkCallback-3396-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 900011 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 900040 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 900082 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 900082 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 900084 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/control-001/cores
   [junit4]   2> 900120 INFO  (zkConnectionManagerCallback-3403-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 900122 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 900123 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36147/solr ready
   [junit4]   2> 900135 INFO  (qtp17352849-13719) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35895_ftbz%252Fr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 900146 INFO  (OverseerThreadFactory-4392-thread-1-processing-n:127.0.0.1:35895_ftbz%2Fr) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 900257 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 900260 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 900265 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 900268 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 900270 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 900319 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 900319 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 901355 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.8.0
   [junit4]   2> 901468 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 901623 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 901652 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 901653 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 901653 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 901658 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=69.0087890625, floorSegmentMB=0.544921875, forceMergeDeletesPctAllowed=4.898248250346656, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6249481524402156, deletesPctAllowed=39.30184382921199
   [junit4]   2> 901667 WARN  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 901736 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 901736 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 901739 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 901739 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 901741 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=91.3271484375, floorSegmentMB=0.59765625, forceMergeDeletesPctAllowed=23.98453932241255, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5970426407475192, deletesPctAllowed=25.183230880633253
   [junit4]   2> 901744 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b7bd51[control_collection_shard1_replica_n1] main]
   [junit4]   2> 901745 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 901745 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 901746 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 901747 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1625968185381486592
   [junit4]   2> 901751 INFO  (searcherExecutor-4397-thread-1-processing-n:127.0.0.1:35895_ftbz%2Fr x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1b7bd51[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 901753 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 901753 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
   [junit4]   2> 901755 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35895/ftbz/r/control_collection_shard1_replica_n1/
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35895/ftbz/r/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 901756 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72071924809990148-core_node2-n_0000000000
   [junit4]   2> 901758 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35895/ftbz/r/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 901859 INFO  (zkCallback-3389-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 901860 INFO  (zkCallback-3389-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 901861 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 901963 INFO  (zkCallback-3389-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 901963 INFO  (zkCallback-3389-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 901965 INFO  (zkCallback-3389-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 902216 INFO  (qtp17352849-13720) [n:127.0.0.1:35895_ftbz%2Fr c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1897
   [junit4]   2> 902219 INFO  (qtp17352849-13719) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 902220 INFO  (qtp17352849-13719) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35895_ftbz%252Fr&wt=javabin&version=2} status=0 QTime=2084
   [junit4]   2> 902232 INFO  (zkConnectionManagerCallback-3408-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902233 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 902234 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36147/solr ready
   [junit4]   2> 902234 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 902236 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 902238 INFO  (OverseerThreadFactory-4392-thread-2-processing-n:127.0.0.1:35895_ftbz%2Fr) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 902239 INFO  (OverseerCollectionConfigSetProcessor-72071924809990148-127.0.0.1:35895_ftbz%2Fr-n_0000000000) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 902441 WARN  (OverseerThreadFactory-4392-thread-2-processing-n:127.0.0.1:35895_ftbz%2Fr) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 902443 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 902444 INFO  (qtp17352849-13718) [n:127.0.0.1:35895_ftbz%2Fr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=208
   [junit4]   2> 902445 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
   [junit4]   2> 902560 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-1-001 of type NRT
   [junit4]   2> 902561 WARN  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 902561 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 902561 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 902562 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 902562 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 902562 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 902562 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 902563 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ebd0c0{/ftbz/r,null,AVAILABLE}
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1fb9dc3{HTTP/1.1,[http/1.1]}{127.0.0.1:39939}
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.e.j.s.Server Started @902594ms
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/ftbz/r, hostPort=39939, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-1-001/cores}
   [junit4]   2> 902564 ERROR (closeThreadPool-3409-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.8.0
   [junit4]   2> 902564 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 902565 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 902565 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-20T06:28:18.510Z
   [junit4]   2> 902574 INFO  (zkConnectionManagerCallback-3411-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902575 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 902575 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-1-001/solr.xml
   [junit4]   2> 902580 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 902580 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 902581 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 902680 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-2-001 of type NRT
   [junit4]   2> 902681 WARN  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 902681 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 902681 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 902681 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 902705 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 902705 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 902705 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 902705 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f31739{/ftbz/r,null,AVAILABLE}
   [junit4]   2> 902706 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1b8fc15{HTTP/1.1,[http/1.1]}{127.0.0.1:33775}
   [junit4]   2> 902706 INFO  (closeThreadPool-3409-thread-2) [    ] o.e.j.s.Server Started @902737ms
   [junit4]   2> 902706 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/ftbz/r, hostPort=33775, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-2-001/cores}
   [junit4]   2> 902706 ERROR (closeThreadPool-3409-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 902707 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 902707 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.8.0
   [junit4]   2> 902707 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 902707 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 902707 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-20T06:28:18.652Z
   [junit4]   2> 902710 INFO  (zkConnectionManagerCallback-3413-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902711 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 902711 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-2-001/solr.xml
   [junit4]   2> 902715 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 902715 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 902734 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 902808 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-3-001 of type NRT
   [junit4]   2> 902809 WARN  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 902810 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 902810 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 902810 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 902866 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 902866 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 902866 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 902878 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a41d0{/ftbz/r,null,AVAILABLE}
   [junit4]   2> 902879 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@cdb3bb{HTTP/1.1,[http/1.1]}{127.0.0.1:34693}
   [junit4]   2> 902879 INFO  (closeThreadPool-3409-thread-3) [    ] o.e.j.s.Server Started @902910ms
   [junit4]   2> 902879 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/ftbz/r, hostPort=34693, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-3-001/cores}
   [junit4]   2> 902880 ERROR (closeThreadPool-3409-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 902880 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 902880 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.8.0
   [junit4]   2> 902880 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 902880 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 902880 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-20T06:28:18.825Z
   [junit4]   2> 902898 INFO  (zkConnectionManagerCallback-3415-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902899 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 902899 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-3-001/solr.xml
   [junit4]   2> 902906 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 902906 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 902908 INFO  (closeThreadPool-3409-thread-3) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 902917 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-4-001 of type NRT
   [junit4]   2> 902918 WARN  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 902918 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 902918 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 902918 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 902919 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1539bdb{/ftbz/r,null,AVAILABLE}
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1a5640c{HTTP/1.1,[http/1.1]}{127.0.0.1:44113}
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.e.j.s.Server Started @902951ms
   [junit4]   2> 902920 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/ftbz/r, hostPort=44113, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-4-001/cores}
   [junit4]   2> 902921 ERROR (closeThreadPool-3409-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 902921 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 902921 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.8.0
   [junit4]   2> 902921 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 902921 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 902921 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-20T06:28:18.866Z
   [junit4]   2> 902934 INFO  (zkConnectionManagerCallback-3417-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902935 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 902935 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1000d08a494000b, likely client has closed socket
   [junit4]   2> 902935 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-4-001/solr.xml
   [junit4]   2> 902936 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 902938 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 902939 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 902940 INFO  (closeThreadPool-3409-thread-4) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 902941 INFO  (closeThreadPool-3409-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36147/solr
   [junit4]   2> 902946 INFO  (zkConnectionManagerCallback-3421-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902970 INFO  (zkConnectionManagerCallback-3423-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 902984 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 902994 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.ZkController Publish node=127.0.0.1:39939_ftbz%2Fr as DOWN
   [junit4]   2> 902997 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 902997 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39939_ftbz%2Fr
   [junit4]   2> 903003 INFO  (zkCallback-3396-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 903003 INFO  (zkCallback-3389-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 903010 INFO  (zkCallback-3407-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 903016 INFO  (zkCallback-3422-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 903036 INFO  (zkConnectionManagerCallback-3430-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 903038 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 903040 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36147/solr ready
   [junit4]   2> 903041 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 903071 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 903091 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 903091 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 903093 INFO  (closeThreadPool-3409-thread-1) [n:127.0.0.1:39939_ftbz%2Fr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-001/shard-1-001/cores
   [junit4]   2> 903421 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 903431 INFO  (closeThreadPool-3409-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36147/solr
   [junit4]   2> 903448 INFO  (zkConnectionManagerCallback-3435-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 903466 INFO  (zkConnectionManagerCallback-3437-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 903471 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 903475 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.ZkController Publish node=127.0.0.1:33775_ftbz%2Fr as DOWN
   [junit4]   2> 903476 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 903476 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33775_ftbz%2Fr
   [junit4]   2> 903477 INFO  (zkCallback-3407-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903477 INFO  (zkCallback-3396-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903478 INFO  (zkCallback-3389-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903482 INFO  (zkCallback-3422-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903486 INFO  (zkCallback-3436-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903502 INFO  (zkCallback-3429-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 903513 INFO  (zkConnectionManagerCallback-3444-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 903514 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 903515 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36147/solr ready
   [junit4]   2> 903517 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 903536 INFO  (closeThreadPool-3409-thread-2) [n:127.0.0.1:33775_ftbz%2Fr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bded7
   [junit4]   2> 903

[...truncated too long message...]

stServer.
   [junit4]   2> 158298 WARN  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/collections/collection1/state.json
   [junit4]   2> 	17	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	13	/solr/collections/collection3/terms/shard1
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	13	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	11	/solr/collections/collection2/terms/shard1
   [junit4]   2> 	11	/solr/collections/collection2/terms/shard2
   [junit4]   2> 	11	/solr/collections/collection3/terms/shard2
   [junit4]   2> 	7	/solr/collections/oneInstanceCollection2/terms/shard1
   [junit4]   2> 	6	/solr/collections/oneInstanceCollection2/terms/shard2
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	4	/solr/collections/oneInstanceCollection/terms/shard1
   [junit4]   2> 	4	/solr/collections/oneInstanceCollection/terms/shard2
   [junit4]   2> 	3	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	72	/solr/collections/collection3/state.json
   [junit4]   2> 	58	/solr/collections/collection2/state.json
   [junit4]   2> 	30	/solr/collections/oneInstanceCollection2/state.json
   [junit4]   2> 	13	/solr/clusterprops.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 	9	/solr/collections/oneInstanceCollection/state.json
   [junit4]   2> 	9	/solr/collections/control_collection/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72072151138500621-127.0.0.1:33197_ftbz%2Fr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	13	/solr/collections
   [junit4]   2> 
   [junit4]   2> 158301 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40121
   [junit4]   2> 158301 INFO  (TEST-BasicDistributedZkTest.test-seed#[CD114BD41B3EBDD3]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40121
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=test -Dtests.seed=CD114BD41B3EBDD3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=el -Dtests.timezone=Africa/Kinshasa -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   68.1s J0 | BasicDistributedZkTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33503/ftbz/r/collection1: Async exception during distributed update: Error from server at http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1: Server Error
   [junit4]    > request: http://127.0.0.1:33197/ftbz/r/collection1_shard2_replica_n1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A33503%2Fftbz%2Fr%2Fcollection1_shard2_replica_n5%2F&wt=javabin&version=2
   [junit4]    > Remote error message: Server error writing document id 68 to the index
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CD114BD41B3EBDD3:4545740EB5C2D02B]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:569)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:747)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:425)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1075)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1047)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_CD114BD41B3EBDD3-002
   [junit4]   2> Feb 20, 2019 7:26:54 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {regex_dup_A_s=FST50, regex_dup_B_s=PostingsFormat(name=LuceneFixedGap), SubjectTerms_mfacet=PostingsFormat(name=LuceneFixedGap), multiDefault=PostingsFormat(name=Memory), genre_s=FST50, author_t=PostingsFormat(name=Memory), series_t=PostingsFormat(name=Memory), rnd_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), oddField_s=FST50, a_t=PostingsFormat(name=LuceneFixedGap), cat=PostingsFormat(name=LuceneFixedGap), foo_b=FST50, name=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), inStock=FST50, id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=FST50}, docValues:{regex_dup_A_s=DocValuesFormat(name=Asserting), other_tl1=DocValuesFormat(name=Direct), regex_dup_B_s=DocValuesFormat(name=Direct), range_facet_l_dv=DocValuesFormat(name=Lucene70), SubjectTerms_mfacet=DocValuesFormat(name=Direct), n_l1=DocValuesFormat(name=Direct), multiDefault=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Direct), genre_s=DocValuesFormat(name=Asserting), n_td1=DocValuesFormat(name=Lucene70), n_d1=DocValuesFormat(name=Direct), range_facet_l=DocValuesFormat(name=Direct), n_f1=DocValuesFormat(name=Lucene70), series_t=DocValuesFormat(name=Lucene70), n_tl1=DocValuesFormat(name=Lucene70), oddField_s=DocValuesFormat(name=Asserting), n_tf1=DocValuesFormat(name=Direct), price=DocValuesFormat(name=Asserting), a_t=DocValuesFormat(name=Direct), cat=DocValuesFormat(name=Direct), sequence_i=DocValuesFormat(name=Asserting), inStock=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Lucene70), text=DocValuesFormat(name=Asserting), intDvoDefault=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Direct), foo_i=DocValuesFormat(name=Lucene70), val_i=DocValuesFormat(name=Lucene70), n_dt1=DocValuesFormat(name=Lucene70), author_t=DocValuesFormat(name=Lucene70), a_i1=DocValuesFormat(name=Direct), n_ti1=DocValuesFormat(name=Lucene70), rnd_b=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Direct), n_tdt1=DocValuesFormat(name=Direct), foo_b=DocValuesFormat(name=Asserting), name=DocValuesFormat(name=Lucene70), id_i1=DocValuesFormat(name=Lucene70), foo_d=DocValuesFormat(name=Lucene70), range_facet_i_dv=DocValuesFormat(name=Direct), foo_f=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=361, maxMBSortInHeap=5.476193965192984, sim=RandomSimilarity(queryNorm=true): {}, locale=el, timezone=Africa/Kinshasa
   [junit4]   2> NOTE: Linux 4.18.0-15-generic i386/Oracle Corporation 1.8.0_172 (32-bit)/cpus=8,threads=1,free=104246864,total=431489024
   [junit4]   2> NOTE: All tests run in this JVM: [BasicDistributedZkTest, BasicDistributedZkTest]
   [junit4] Completed [5/5 (5!)] on J0 in 68.55s, 1 test, 1 error <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux/lucene/common-build.xml:1099: There were test failures: 5 suites, 5 tests, 5 errors [seed: CD114BD41B3EBDD3]

Total time: 2 minutes 41 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.BasicDistributedZkTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=70f4c64f31d345f5d02c2201574f60ee38e1c631, workspace=/home/jenkins/workspace/Lucene-Solr-BadApples-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #163
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2