You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/01/30 02:07:19 UTC
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-13.0.2) - Build #
25528 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/25528/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest: 1) Thread[id=14356, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135) 2) Thread[id=14355, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135) 3) Thread[id=14357, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest:
1) Thread[id=14356, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135)
2) Thread[id=14355, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135)
3) Thread[id=14357, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55)
at __randomizedtesting.SeedInfo.seed([5D5A5E1A04D4FA34]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=14356, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest] at java.base@13.0.2/java.util.HashMap.putVal(HashMap.java:664) at java.base@13.0.2/java.util.HashMap.put(HashMap.java:612) at app//org.apache.solr.client.solrj.request.UpdateRequest.add(UpdateRequest.java:174) at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:174) at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115) 2) Thread[id=14355, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest] at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeBufferLoop(UTF_8.java:555) at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:566) at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578) at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:801) at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:848) at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:868) at app//org.apache.http.client.utils.URLEncodedUtils.urlEncode(URLEncodedUtils.java:627) at app//org.apache.http.client.utils.URLEncodedUtils.formatSegments(URLEncodedUtils.java:394) at app//org.apache.http.client.utils.URIBuilder.encodePath(URIBuilder.java:209) at app//org.apache.http.client.utils.URIBuilder.buildString(URIBuilder.java:159) at app//org.apache.http.client.utils.URIBuilder.build(URIBuilder.java:127) at app//org.apache.http.client.utils.URIUtils.rewriteURI(URIUtils.java:235) at app//org.apache.http.client.utils.URIUtils.rewriteURIForRoute(URIUtils.java:319) at app//org.apache.http.impl.execchain.ProtocolExec.rewriteRequestURI(ProtocolExec.java:96) at app//org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:133) at app//org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at app//org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at app//org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248) at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207) at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224) at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176) at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=14356, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
at java.base@13.0.2/java.util.HashMap.putVal(HashMap.java:664)
at java.base@13.0.2/java.util.HashMap.put(HashMap.java:612)
at app//org.apache.solr.client.solrj.request.UpdateRequest.add(UpdateRequest.java:174)
at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:174)
at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
2) Thread[id=14355, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeBufferLoop(UTF_8.java:555)
at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:566)
at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578)
at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:801)
at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:848)
at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:868)
at app//org.apache.http.client.utils.URLEncodedUtils.urlEncode(URLEncodedUtils.java:627)
at app//org.apache.http.client.utils.URLEncodedUtils.formatSegments(URLEncodedUtils.java:394)
at app//org.apache.http.client.utils.URIBuilder.encodePath(URIBuilder.java:209)
at app//org.apache.http.client.utils.URIBuilder.buildString(URIBuilder.java:159)
at app//org.apache.http.client.utils.URIBuilder.build(URIBuilder.java:127)
at app//org.apache.http.client.utils.URIUtils.rewriteURI(URIUtils.java:235)
at app//org.apache.http.client.utils.URIUtils.rewriteURIForRoute(URIUtils.java:319)
at app//org.apache.http.impl.execchain.ProtocolExec.rewriteRequestURI(ProtocolExec.java:96)
at app//org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:133)
at app//org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at app//org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at app//org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176)
at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
at __randomizedtesting.SeedInfo.seed([5D5A5E1A04D4FA34]:0)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test
Error Message:
timeout value is negative
Stack Trace:
java.lang.IllegalArgumentException: timeout value is negative
at __randomizedtesting.SeedInfo.seed([5D5A5E1A04D4FA34:D50E61C0AA2897CC]:0)
at java.base/java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.ChaosMonkey.wait(ChaosMonkey.java:641)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:174)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:830)
Build Log:
[...truncated 14455 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
[junit4] 2> 641046 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 641047 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/data-dir-81-001
[junit4] 2> 641047 WARN (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
[junit4] 2> 641047 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 641048 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 641048 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[5D5A5E1A04D4FA34]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 641048 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ChaosMonkeySafeLeaderWithPullReplicasTest Starting ChaosMonkey test with 1 shards and 3 nodes
[junit4] 2> 641051 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 641051 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 641051 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 641151 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer start zk server on port:44777
[junit4] 2> 641151 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44777
[junit4] 2> 641151 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44777
[junit4] 2> 641151 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44777
[junit4] 2> 641152 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641153 INFO (zkConnectionManagerCallback-3877-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641154 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641155 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641156 INFO (zkConnectionManagerCallback-3879-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641156 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641157 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 641158 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 641159 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 641160 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 641160 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 641161 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 641161 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 641161 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 641162 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 641162 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 641162 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkTestServer put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 641164 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641164 INFO (zkConnectionManagerCallback-3883-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641164 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641266 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 641340 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 641340 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 641340 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 641341 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 641343 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 641344 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 641344 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 641344 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@686a70b7{/,null,AVAILABLE}
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@48279c6c{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:34387}
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.s.Server Started @641353ms
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/tempDir-001/control/data, hostPort=34387, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/control-001/cores, replicaType=NRT}
[junit4] 2> 641345 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 641345 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-30T01:52:26.383576Z
[junit4] 2> 641346 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641347 INFO (zkConnectionManagerCallback-3885-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641347 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641447 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 641447 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/control-001/solr.xml
[junit4] 2> 641449 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 641449 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 641450 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 641527 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 641528 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4e41b830[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 641528 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4e41b830[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 641530 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3f0e1c69[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 641530 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3f0e1c69[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 641530 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44777/solr
[junit4] 2> 641531 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641532 INFO (zkConnectionManagerCallback-3892-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641532 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641633 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641634 INFO (zkConnectionManagerCallback-3894-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641634 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641658 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34387_
[junit4] 2> 641658 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.Overseer Overseer (id=72097732126244869-127.0.0.1:34387_-n_0000000000) starting
[junit4] 2> 641660 INFO (OverseerStateUpdate-72097732126244869-127.0.0.1:34387_-n_0000000000) [n:127.0.0.1:34387_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:34387_
[junit4] 2> 641660 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34387_
[junit4] 2> 641661 INFO (zkCallback-3893-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 641661 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 641662 WARN (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 641669 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 641680 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 641686 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 641686 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 641687 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [n:127.0.0.1:34387_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/control-001/cores
[junit4] 2> 641697 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 641698 INFO (zkConnectionManagerCallback-3903-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 641698 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 641698 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 641698 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44777/solr ready
[junit4] 2> 641706 INFO (qtp1151545329-14187) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34387_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 641707 INFO (OverseerThreadFactory-3718-thread-1-processing-n:127.0.0.1:34387_) [n:127.0.0.1:34387_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 641813 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 641813 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 642819 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 642830 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 642888 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 642895 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 642895 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 642896 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 642897 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=56.572265625, floorSegmentMB=1.9873046875, forceMergeDeletesPctAllowed=0.4792864722117596, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43181405586339094, deletesPctAllowed=29.590087931514443
[junit4] 2> 642900 WARN (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 642926 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 642926 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 642927 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 642927 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 642928 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=13.5107421875, floorSegmentMB=1.4521484375, forceMergeDeletesPctAllowed=4.79187030917421, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.81773306325563
[junit4] 2> 642928 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@59e94516[control_collection_shard1_replica_n1] main]
[junit4] 2> 642929 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 642929 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 642929 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 642929 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1657116188178644992
[junit4] 2> 642931 INFO (searcherExecutor-3723-thread-1-processing-n:127.0.0.1:34387_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@59e94516[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 642932 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 642932 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34387/control_collection_shard1_replica_n1/
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:34387/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 642933 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72097732126244869-core_node2-n_0000000000
[junit4] 2> 642934 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34387/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 643035 INFO (zkCallback-3893-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 643035 INFO (zkCallback-3893-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 643035 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 643036 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1223
[junit4] 2> 643037 INFO (qtp1151545329-14187) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 643136 INFO (zkCallback-3893-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 643136 INFO (zkCallback-3893-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 643136 INFO (zkCallback-3893-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 643137 INFO (qtp1151545329-14187) [n:127.0.0.1:34387_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34387_&wt=javabin&version=2} status=0 QTime=1430
[junit4] 2> 643137 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 643240 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643240 INFO (zkConnectionManagerCallback-3909-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643240 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643241 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 643241 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44777/solr ready
[junit4] 2> 643241 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 643247 INFO (qtp1151545329-14192) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 643249 INFO (OverseerThreadFactory-3718-thread-2-processing-n:127.0.0.1:34387_) [n:127.0.0.1:34387_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 643249 INFO (OverseerCollectionConfigSetProcessor-72097732126244869-127.0.0.1:34387_-n_0000000000) [n:127.0.0.1:34387_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 643450 WARN (OverseerThreadFactory-3718-thread-2-processing-n:127.0.0.1:34387_) [n:127.0.0.1:34387_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 643451 INFO (qtp1151545329-14192) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 643451 INFO (qtp1151545329-14192) [n:127.0.0.1:34387_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 643452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=1 numOtherReplicas=2
[junit4] 2> 643538 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-1-001 of type NRT for shard1
[junit4] 2> 643540 WARN (closeThreadPool-3910-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 643540 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53b36d0d{/,null,AVAILABLE}
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9e6e3a1{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:41803}
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.e.j.s.Server Started @643550ms
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/tempDir-001/jetty1, hostPort=41803, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 643541 ERROR (closeThreadPool-3910-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 643541 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-30T01:52:28.579919Z
[junit4] 2> 643542 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643543 INFO (zkConnectionManagerCallback-3912-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643543 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643605 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001 of type NRT for shard1
[junit4] 2> 643607 WARN (closeThreadPool-3910-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 643607 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 643607 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 643607 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 643608 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 643608 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 643608 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 643609 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@163398c3{/,null,AVAILABLE}
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@57e0099a{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:41901}
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.e.j.s.Server Started @643618ms
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/tempDir-001/jetty2, hostPort=41901, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 643610 ERROR (closeThreadPool-3910-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 643610 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-30T01:52:28.648448Z
[junit4] 2> 643611 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643612 INFO (zkConnectionManagerCallback-3914-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643612 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643643 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 643643 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-1-001/solr.xml
[junit4] 2> 643645 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 643645 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 643646 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 643672 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[5D5A5E1A04D4FA34]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-3-001 of type PULL for shard1
[junit4] 2> 643674 WARN (closeThreadPool-3910-thread-3) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 643675 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48bfb9d4{/,null,AVAILABLE}
[junit4] 2> 643676 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6a746d1f{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:36933}
[junit4] 2> 643676 INFO (closeThreadPool-3910-thread-3) [ ] o.e.j.s.Server Started @643685ms
[junit4] 2> 643676 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/tempDir-001/jetty3, hostPort=36933, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-3-001/cores, replicaType=PULL}
[junit4] 2> 643676 ERROR (closeThreadPool-3910-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 643676 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 643677 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 643677 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 643677 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr
[junit4] 2> 643677 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-30T01:52:28.715086Z
[junit4] 2> 643677 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643678 INFO (zkConnectionManagerCallback-3917-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643678 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643728 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 643729 WARN (closeThreadPool-3910-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2be35a58[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643729 WARN (closeThreadPool-3910-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2be35a58[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643731 WARN (closeThreadPool-3910-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@70cd1608[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643731 WARN (closeThreadPool-3910-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@70cd1608[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643731 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44777/solr
[junit4] 2> 643732 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643732 INFO (zkConnectionManagerCallback-3923-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643732 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643744 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 643744 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001/solr.xml
[junit4] 2> 643745 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 643745 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 643746 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 643844 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643845 INFO (zkConnectionManagerCallback-3926-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643845 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643847 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 643849 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.ZkController Publish node=127.0.0.1:41803_ as DOWN
[junit4] 2> 643850 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 643850 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41803_
[junit4] 2> 643850 INFO (zkCallback-3893-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 643850 INFO (zkCallback-3908-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 643850 INFO (zkCallback-3925-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 643851 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 643851 WARN (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 643858 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 643865 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 643866 WARN (closeThreadPool-3910-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@42f777d6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643866 WARN (closeThreadPool-3910-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@42f777d6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643868 WARN (closeThreadPool-3910-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@17012b88[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643868 WARN (closeThreadPool-3910-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@17012b88[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 643869 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44777/solr
[junit4] 2> 643870 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 643871 INFO (zkConnectionManagerCallback-3936-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 643871 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 643871 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 643878 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 643878 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 643879 INFO (closeThreadPool-3910-thread-1) [n:127.0.0.1:41803_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-1-001/cores
[junit4] 2> 643890 INFO (closeThreadPool-3910-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:41803_
[junit4] 2> 643944 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 643944 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-3-001/solr.xml
[junit4] 2> 643946 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 643946 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 643947 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 644044 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 644045 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 644045 WARN (closeThreadPool-3910-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5912079e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 644045 WARN (closeThreadPool-3910-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5912079e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 644045 INFO (zkConnectionManagerCallback-3939-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 644045 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 644046 WARN (closeThreadPool-3910-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5f05e285[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 644046 WARN (closeThreadPool-3910-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5f05e285[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 644047 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44777/solr
[junit4] 2> 644047 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 644047 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 644048 INFO (zkConnectionManagerCallback-3947-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 644048 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 644049 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.ZkController Publish node=127.0.0.1:41901_ as DOWN
[junit4] 2> 644049 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 644049 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41901_
[junit4] 2> 644050 INFO (zkCallback-3908-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 644050 INFO (zkCallback-3893-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 644050 INFO (zkCallback-3925-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 644050 INFO (zkCallback-3938-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 644050 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 644051 WARN (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 644056 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 644065 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644070 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644070 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644071 INFO (closeThreadPool-3910-thread-2) [n:127.0.0.1:41901_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001/cores
[junit4] 2> 644090 INFO (closeThreadPool-3910-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:41901_
[junit4] 2> 644149 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 644150 INFO (zkConnectionManagerCallback-3951-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 644150 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 644152 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 644153 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.ZkController Publish node=127.0.0.1:36933_ as DOWN
[junit4] 2> 644154 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 644154 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36933_
[junit4] 2> 644154 INFO (zkCallback-3908-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 644154 INFO (zkCallback-3893-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 644154 INFO (zkCallback-3925-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 644154 INFO (zkCallback-3950-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 644154 INFO (zkCallback-3938-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 644155 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 644155 WARN (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 644160 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 644170 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644175 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644175 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 644175 INFO (closeThreadPool-3910-thread-3) [n:127.0.0.1:36933_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-3-001/cores
[junit4] 2> 644194 INFO (closeThreadPool-3910-thread-3) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:36933_
[junit4] 2> 644196 INFO (qtp1151545329-14187) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41901_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 644197 INFO (OverseerCollectionConfigSetProcessor-72097732126244869-127.0.0.1:34387_-n_0000000000) [n:127.0.0.1:34387_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 644198 INFO (OverseerThreadFactory-3718-thread-3-processing-n:127.0.0.1:34387_) [n:127.0.0.1:34387_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:41901_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 644198 INFO (OverseerThreadFactory-3718-thread-3-processing-n:127.0.0.1:34387_) [n:127.0.0.1:34387_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 644200 INFO (qtp1151545329-14189) [n:127.0.0.1:34387_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41803_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 644208 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 645222 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 645255 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=test
[junit4] 2> 645302 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 645313 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 645314 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@553f68b0
[junit4] 2> 645314 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001/cores/collection1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_5D5A5E1A04D4FA34-001/shard-2-001/cores/collection1_shard1_replica_n1/data/]
[junit4] 2> 645316 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=56.572265625, floorSegmentMB=1.9873046875, forceMergeDeletesPctAllowed=0.4792864722117596, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43181405586339094, deletesPctAllowed=29.590087931514443
[junit4] 2> 645322 WARN (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 645365 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 645365 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 645366 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 645366 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 645367 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=13.5107421875, floorSegmentMB=1.4521484375, forceMergeDeletesPctAllowed=4.79187030917421, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.81773306325563
[junit4] 2> 645367 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@74a58176[collection1_shard1_replica_n1] main]
[junit4] 2> 645368 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 645368 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 645369 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 645369 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1657116190737170432
[junit4] 2> 645370 INFO (searcherExecutor-3755-thread-1-processing-n:127.0.0.1:41901_ x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@74a58176[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 645371 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 645371 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41901/collection1_shard1_replica_n1/
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:41901/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72097732126244878-core_node2-n_0000000000
[junit4] 2> 645373 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41901/collection1_shard1_replica_n1/ shard1
[junit4] 2> 645480 INFO (qtp2071260706-14311) [n:127.0.0.1:41901_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 645483 INFO (qtp2071260706-14311) [n:127.
[...truncated too long message...]
quest.java:224)
[junit4] 2> at org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176)
[junit4] 2> at org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
[junit4] 2> NOTE: Linux 5.3.0-26-generic amd64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=16,threads=3,free=193262784,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [PackageManagerCLITest, TestRestManager, PeerSyncWithLeaderAndIndexFingerprintCachingTest, TransactionLogTest, SolrCLIZkUtilsTest, DistributedQueryComponentCustomSortTest, DistribCursorPagingTest, XsltUpdateRequestHandlerTest, TemplateUpdateProcessorTest, TestConfigSetsAPI, TestHdfsCloudBackupRestore, CollectionTooManyReplicasTest, TestAuthenticationFramework, TestHalfAndHalfDocValues, TestShortCircuitedRequests, ZkNodePropsTest, TestSchemaVersionResource, EchoParamsTest, BasicAuthOnSingleNodeTest, SpellingQueryConverterTest, TestFuzzyAnalyzedSuggestions, TestMinMaxOnMultiValuedField, TestPayloadScoreQParserPlugin, TestSolrCoreProperties, DirectUpdateHandlerTest, NodeLostTriggerIntegrationTest, SSLMigrationTest, HdfsChaosMonkeySafeLeaderTest, HLLUtilTest, ReplaceNodeNoTargetTest, TestSolrDeletionPolicy2, TestHashPartitioner, TestElisionMultitermQuery, TriLevelCompositeIdRoutingTest, TestXmlQParserPlugin, FacetPivotSmallTest, TestInPlaceUpdatesDistrib, TestExplainDocTransformer, HdfsDirectoryTest, TestBackupRepositoryFactory, IndexSizeTriggerSizeEstimationTest, TestLuceneIndexBackCompat, TestConfigSetProperties, TestGraphTermsQParserPlugin, SolrRrdBackendFactoryTest, BigEndianAscendingWordDeserializerTest, RegexBoostProcessorTest, HighlighterConfigTest, TestBinaryField, UtilsToolTest, CleanupOldIndexTest, TestJsonFacetRefinement, TestExportTool, SuggesterWFSTTest, OpenExchangeRatesOrgProviderTest, HdfsThreadLeakTest, TestMiniSolrCloudClusterSSL, TestStressCloudBlindAtomicUpdates, TestMinHashQParser, ForceLeaderTest, CoreAdminRequestStatusTest, TestPerFieldSimilarity, TestSimDistributedQueue, LukeRequestHandlerTest, MultiDestinationAuditLoggerTest, DistributedFacetPivotLargeTest, TestQuerySenderNoQuery, HttpPartitionWithTlogReplicasTest, OrderedExecutorTest, RandomizedTaggerTest, LeaderTragicEventTest, BaseCdcrDistributedZkTest, AutoScalingHandlerTest, FuzzySearchTest, TestSort, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestDocumentBuilder, TestGroupingSearch, TestHighlightDedupGrouping, TestJoin, TestRandomDVFaceting, AddReplicaTest, BasicDistributedZk2Test, BasicZkTest, ChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest -Dtests.seed=5D5A5E1A04D4FA34 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=so-DJ -Dtests.timezone=Asia/Ujung_Pandang -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | ChaosMonkeySafeLeaderWithPullReplicasTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest:
[junit4] > 1) Thread[id=14356, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135)
[junit4] > 2) Thread[id=14355, name=StoppableIndexingThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:135)
[junit4] > 3) Thread[id=14357, name=StoppableCommitThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.solr.cloud.StoppableCommitThread.run(StoppableCommitThread.java:55)
[junit4] > at __randomizedtesting.SeedInfo.seed([5D5A5E1A04D4FA34]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=14356, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] > at java.base@13.0.2/java.util.HashMap.putVal(HashMap.java:664)
[junit4] > at java.base@13.0.2/java.util.HashMap.put(HashMap.java:612)
[junit4] > at app//org.apache.solr.client.solrj.request.UpdateRequest.add(UpdateRequest.java:174)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:174)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
[junit4] > 2) Thread[id=14355, name=StoppableIndexingThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] > at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeBufferLoop(UTF_8.java:555)
[junit4] > at java.base@13.0.2/sun.nio.cs.UTF_8$Encoder.encodeLoop(UTF_8.java:566)
[junit4] > at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:578)
[junit4] > at java.base@13.0.2/java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:801)
[junit4] > at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:848)
[junit4] > at java.base@13.0.2/java.nio.charset.Charset.encode(Charset.java:868)
[junit4] > at app//org.apache.http.client.utils.URLEncodedUtils.urlEncode(URLEncodedUtils.java:627)
[junit4] > at app//org.apache.http.client.utils.URLEncodedUtils.formatSegments(URLEncodedUtils.java:394)
[junit4] > at app//org.apache.http.client.utils.URIBuilder.encodePath(URIBuilder.java:209)
[junit4] > at app//org.apache.http.client.utils.URIBuilder.buildString(URIBuilder.java:159)
[junit4] > at app//org.apache.http.client.utils.URIBuilder.build(URIBuilder.java:127)
[junit4] > at app//org.apache.http.client.utils.URIUtils.rewriteURI(URIUtils.java:235)
[junit4] > at app//org.apache.http.client.utils.URIUtils.rewriteURIForRoute(URIUtils.java:319)
[junit4] > at app//org.apache.http.impl.execchain.ProtocolExec.rewriteRequestURI(ProtocolExec.java:96)
[junit4] > at app//org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:133)
[junit4] > at app//org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at app//org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] > at app//org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at app//org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
[junit4] > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
[junit4] > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] > at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.indexDocs(StoppableIndexingThread.java:176)
[junit4] > at app//org.apache.solr.cloud.StoppableIndexingThread.run(StoppableIndexingThread.java:115)
[junit4] > at __randomizedtesting.SeedInfo.seed([5D5A5E1A04D4FA34]:0)
[junit4] Completed [459/900 (1!)] on J0 in 34.94s, 1 test, 3 errors <<< FAILURES!
[...truncated 46129 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/25528/consoleText
[repro] Revision: 29469b454f199bdaf8615280bdf7a146ef8f7ec6
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest -Dtests.method=test -Dtests.seed=5D5A5E1A04D4FA34 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=so-DJ -Dtests.timezone=Asia/Ujung_Pandang -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] Repro line: ant test -Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest -Dtests.seed=5D5A5E1A04D4FA34 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=so-DJ -Dtests.timezone=Asia/Ujung_Pandang -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ChaosMonkeySafeLeaderWithPullReplicasTest
[repro] ant compile-test
[...truncated 3218 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ChaosMonkeySafeLeaderWithPullReplicasTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=5D5A5E1A04D4FA34 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=so-DJ -Dtests.timezone=Asia/Ujung_Pandang -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 81 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
[repro] Exiting with code 0
[...truncated 43 lines...]
[JENKINS-Experimental-GC] Lucene-Solr-master-Linux
(64bit/jdk-12.0.2) - Build # 25530 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/25530/
Java: 64bit/jdk-12.0.2 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
All tests passed
Build Log:
[...truncated 1110 lines...]
[junit4] JVM J5: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J5-20200130_053118_10617947880389465207793.sysout
[junit4] >>> JVM J5 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # A fatal error has been detected by the Java Runtime Environment:
[junit4] #
[junit4] # SIGSEGV (0xb) at pc=0x00007fc365587c31, pid=17819, tid=20766
[junit4] #
[junit4] # JRE version: OpenJDK Runtime Environment (12.0.2+10) (build 12.0.2+10)
[junit4] # Java VM: OpenJDK 64-Bit Server VM (12.0.2+10, mixed mode, tiered, z gc, linux-amd64)
[junit4] # Problematic frame:
[junit4] # V [libjvm.so+0xac5c31] PhaseIdealLoop::build_loop_late_post_work(Node*, bool)+0x171
[junit4] #
[junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
[junit4] #
[junit4] # An error report file with more information is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/J5/hs_err_pid17819.log
[junit4] #
[junit4] # Compiler replay data is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/J5/replay_pid17819.log
[junit4] #
[junit4] # If you would like to submit a bug report, please visit:
[junit4] # https://github.com/AdoptOpenJDK/openjdk-build/issues
[junit4] #
[junit4] <<< JVM J5: EOF ----
[...truncated 1003 lines...]
[junit4] ERROR: JVM J5 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-12.0.2/bin/java -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=835D87C8EF29F34C -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/J5 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp -Djunit4.childvm.id=5 -Djunit4.childvm.count=6 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=false -classpath /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/test:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.6.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J5-20200130_053118_10614398895262354418340.events @/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J5-20200130_053118_10615898555870971804193.suites -stdin
[junit4] ERROR: JVM J5 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J5-20200130_053118_10617947880389465207793.sysout
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
[junit4] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] at java.base/java.lang.Thread.run(Thread.java:835)
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:634: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:578: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build.xml:50: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1510: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1037: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J5-20200130_053118_10617947880389465207793.sysout
Total time: 4 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS-Experimental-GC] Lucene-Solr-master-Linux
(64bit/jdk-13.0.2) - Build # 25529 - Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/25529/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC -XX:ShenandoahCodeRootsStyle=1
All tests passed
Build Log:
[...truncated 14812 lines...]
[junit4] JVM J1: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200130_034352_68310285191905117174591.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # A fatal error has been detected by the Java Runtime Environment:
[junit4] #
[junit4] # SIGSEGV (0xb) at pc=0x00007f74b17c2fd9, pid=2784, tid=20963
[junit4] #
[junit4] # JRE version: OpenJDK Runtime Environment (13.0.2+8) (build 13.0.2+8)
[junit4] # Java VM: OpenJDK 64-Bit Server VM (13.0.2+8, mixed mode, tiered, shenandoah gc, linux-amd64)
[junit4] # Problematic frame:
[junit4] # V [libjvm.so+0xcd3fd9] PhaseIterGVN::transform_old(Node*)+0x159
[junit4] #
[junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
[junit4] #
[junit4] # An error report file with more information is saved as:
[junit4] # /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/hs_err_pid2784.log
[junit4] [thread 19556 also had an error]
[junit4]
[junit4] ------ Timeout during error reporting after 120 s. ------
[junit4] # [ timer expired, abort... ]
[junit4] <<< JVM J1: EOF ----
[...truncated 1234 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-13.0.2/bin/java -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC -XX:ShenandoahCodeRootsStyle=1 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=63AF484D1CB4AF7F -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/etc/security.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp -Djunit4.childvm.id=1 -Djunit4.childvm.count=6 -Dfile.encoding=UTF-8 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=false -classpath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/junit4-ant-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/test-framework/lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/lucene-analyzers-common-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/nori/lucene-analyzers-nori-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/lucene-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/lucene-backward-codecs-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/lucene-highlighter-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/lucene-memory-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/lucene-misc-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/lucene-spatial-extras-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/lucene-spatial3d-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/lucene-expressions-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/lucene-suggest-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/lucene-grouping-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/lucene-queries-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/lucene-queryparser-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/lucene-join-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/lucene-sandbox-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/lucene-classification-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-commons-7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/avatica-core-1.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/caffeine-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-core-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/calcite-linq4j-1.18.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-cli-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-codec-1.13.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-collections-3.2.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-compiler-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-configuration2-2.1.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-exec-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-fileupload-1.3.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-lang3-3.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-client-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-framework-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-recipes-2.13.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/disruptor-3.4.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/eigenbase-properties-1.1.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/guava-25.1-jre.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-annotations-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-auth-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-common-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-hdfs-client-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hppc-0.8.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/htrace-core4-4.1.0-incubating.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-annotations-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-core-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-databind-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-dataformat-smile-2.10.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/janino-3.0.9.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/java-semver-0.9.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jose4j-0.6.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/json-path-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-core-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerb-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-asn1-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/kerby-pkix-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-1.2-api-2.11.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-api-2.11.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-core-2.11.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-slf4j-impl-2.11.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-api-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-noop-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/opentracing-util-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/protobuf-java-3.11.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/re2j-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/rrd4j-3.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/s2-geometry-library-java-1.0.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/spatial4j-0.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/t-digest-3.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-io-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-math3-3.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-client-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-common-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-hpack-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/http2-http-client-transport-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpclient-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpcore-4.4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpmime-4.5.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jcl-over-slf4j-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-client-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-alpn-java-client-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-client-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-http-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-io-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jetty-util-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-buffer-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-codec-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-common-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-handler-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-resolver-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-native-epoll-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/netty-transport-native-unix-common-4.1.29.Final.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/slf4j-api-1.7.24.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/stax2-api-3.1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-3.5.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-jute-3.5.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-common-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-hpack-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/http2-server-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/javax.servlet-api-3.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-java-server-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-alpn-server-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-continuation-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-deploy-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-http-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-io-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-jmx-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-rewrite-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-security-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-server-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlet-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlets-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-util-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-webapp-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-xml-9.4.24.v20191120.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-core-4.1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-graphite-4.1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jetty9-4.1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jmx-4.1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/metrics-jvm-4.1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-2.4.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/byte-buddy-1.9.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-compress-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-logging-1.1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/commons-text-1.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-common-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0-tests.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-hdfs-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/hadoop-minikdc-3.2.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/jersey-servlet-1.19.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-admin-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-client-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-common-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-crypto-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-identity-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-server-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerb-simplekdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-config-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-kdc-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/kerby-util-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/mockito-core-2.23.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/objenesis-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/test-lib/opentracing-mock-0.33.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/lucene-analyzers-icu-9.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analysis-extras/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/contrib/analysis-extras/lib/icu4j-62.2.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.6.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200130_034352_6835953117595225845322.events @/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200130_034352_68315791784277464306557.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200130_034352_68310285191905117174591.sysout
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
[junit4] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] at java.base/java.lang.Thread.run(Thread.java:830)
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:634: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:578: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:232: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:549: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1510: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1037: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20200130_034352_68310285191905117174591.sysout
Total time: 38 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2