You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/07/09 09:24:29 UTC
[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1580 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1580/
4 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)
FAILED: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3:73579C7C71FBEC2B]:0)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
at org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes(TestDeleteCollectionOnDownNodes.java:47)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.search.mlt.SimpleMLTQParserTest.doTest
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3:4A2640203A63B31A]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
at org.apache.solr.search.mlt.SimpleMLTQParserTest.doTest(SimpleMLTQParserTest.java:82)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result/doc[1]/str[@name='id'][.='13']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">394</int></lst><result name="response" numFound="16" start="0"><doc><str name="id">16</str><arr name="range_facet_l"><long>16</long></arr><int name="id_i1">16</int><arr name="range_facet_l_dv"><long>16</long></arr><arr name="range_facet_i_dv"><int>16</int></arr><arr name="lowerfilt"><str>The slim red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The slim red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.959Z</date><long name="_version_">1605498167056400384</long><int name="intDvoDefault">42</int></doc><doc><str name="id">18</str><arr name="range_facet_l"><long>18</long></arr><int name="id_i1">18</int><arr name="range_facet_l_dv"><long>18</long></arr><arr name="range_facet_i_dv"><int>18</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.960Z</date><long name="_version_">1605498167057448960</long><int name="intDvoDefault">42</int></doc><doc><str name="id">19</str><arr name="range_facet_l"><long>19</long></arr><int name="id_i1">19</int><arr name="range_facet_l_dv"><long>19</long></arr><arr name="range_facet_i_dv"><int>19</int></arr><arr name="lowerfilt"><str>The hose red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The hose red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.960Z</date><long name="_version_">1605498167057448961</long><int name="intDvoDefault">42</int></doc><doc><str name="id">20</str><arr name="range_facet_l"><long>20</long></arr><int name="id_i1">20</int><arr name="range_facet_l_dv"><long>20</long></arr><arr name="range_facet_i_dv"><int>20</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.960Z</date><long name="_version_">1605498167057448962</long><int name="intDvoDefault">42</int></doc><doc><str name="id">21</str><arr name="range_facet_l"><long>21</long></arr><int name="id_i1">21</int><arr name="range_facet_l_dv"><long>21</long></arr><arr name="range_facet_i_dv"><int>21</int></arr><arr name="lowerfilt"><str>The court red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The court red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.961Z</date><long name="_version_">1605498167058497536</long><int name="intDvoDefault">42</int></doc><doc><str name="id">22</str><arr name="range_facet_l"><long>22</long></arr><int name="id_i1">22</int><arr name="range_facet_l_dv"><long>22</long></arr><arr name="range_facet_i_dv"><int>22</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.961Z</date><long name="_version_">1605498167058497537</long><int name="intDvoDefault">42</int></doc><doc><str name="id">23</str><arr name="range_facet_l"><long>23</long></arr><int name="id_i1">23</int><arr name="range_facet_l_dv"><long>23</long></arr><arr name="range_facet_i_dv"><int>23</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.961Z</date><long name="_version_">1605498167076323328</long><int name="intDvoDefault">42</int></doc><doc><str name="id">24</str><arr name="range_facet_l"><long>24</long></arr><int name="id_i1">24</int><arr name="range_facet_l_dv"><long>24</long></arr><arr name="range_facet_i_dv"><int>24</int></arr><arr name="lowerfilt"><str>The file red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The file red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.978Z</date><long name="_version_">1605498167076323329</long><int name="intDvoDefault">42</int></doc><doc><str name="id">13</str><arr name="range_facet_l"><long>13</long></arr><int name="id_i1">13</int><arr name="range_facet_l_dv"><long>13</long></arr><arr name="range_facet_i_dv"><int>13</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.851Z</date><long name="_version_">1605498166943154177</long><int name="intDvoDefault">42</int></doc><doc><str name="id">14</str><arr name="range_facet_l"><long>14</long></arr><int name="id_i1">14</int><arr name="range_facet_l_dv"><long>14</long></arr><arr name="range_facet_i_dv"><int>14</int></arr><arr name="lowerfilt"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int name="intDefault">42</int><date name="timestamp">2018-07-09T07:46:06.884Z</date><long name="_version_">1605498166977757184</long><int name="intDvoDefault">42</int></doc></result>
</response>
request was:q={!mlt+qf%3Dlowerfilt}17
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:910)
... 41 more
Build Log:
[...truncated 14825 lines...]
[junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
[junit4] 2> 4795802 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/init-core-data-001
[junit4] 2> 4795803 WARN (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=13 numCloses=13
[junit4] 2> 4795803 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 4795822 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 4795823 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001
[junit4] 2> 4795823 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 4795823 INFO (Thread-15089) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4795823 INFO (Thread-15089) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 4795825 ERROR (Thread-15089) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 4795924 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:33482
[junit4] 2> 4796033 INFO (zkConnectionManagerCallback-65718-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4796108 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 4796144 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 4796160 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 4796160 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 4796216 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 4796216 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 4796216 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 4796217 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2bd06f04{/solr,null,AVAILABLE}
[junit4] 2> 4796253 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 4796253 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 4796253 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 4796289 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 4796289 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 4796290 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 4796362 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3228bd0f{/solr,null,AVAILABLE}
[junit4] 2> 4796363 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3daafdcd{/solr,null,AVAILABLE}
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5808a672{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40769}
[junit4] 2> 4796445 ERROR (jetty-launcher-65715-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4796445 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-09T06:48:51.235Z
[junit4] 2> 4796452 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 4796452 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 4796452 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 4796489 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2cad898a{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 4796489 INFO (jetty-launcher-65715-thread-2) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 4796489 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38417}
[junit4] 2> 4796490 ERROR (jetty-launcher-65715-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4796490 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 4796490 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 4796490 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4796490 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4796490 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-09T06:48:51.280Z
[junit4] 2> 4796509 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a175782{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 4796509 INFO (jetty-launcher-65715-thread-1) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 4796509 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42621}
[junit4] 2> 4796509 ERROR (jetty-launcher-65715-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4796510 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 4796510 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 4796510 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4796510 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4796510 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-09T06:48:51.300Z
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13dfdfed{/solr,null,AVAILABLE}
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7cdf986e{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43508}
[junit4] 2> 4796555 ERROR (jetty-launcher-65715-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4796555 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-07-09T06:48:51.345Z
[junit4] 2> 4796582 INFO (zkConnectionManagerCallback-65720-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4796583 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4796618 INFO (zkConnectionManagerCallback-65724-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4796619 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4796707 INFO (zkConnectionManagerCallback-65722-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4796891 INFO (zkConnectionManagerCallback-65726-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4796927 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4796927 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4798871 INFO (jetty-launcher-65715-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
[junit4] 2> 4798939 INFO (zkConnectionManagerCallback-65730-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4799071 INFO (jetty-launcher-65715-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
[junit4] 2> 4799199 INFO (zkConnectionManagerCallback-65734-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4799211 INFO (zkConnectionManagerCallback-65736-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4799337 INFO (zkConnectionManagerCallback-65738-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4799875 INFO (jetty-launcher-65715-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
[junit4] 2> 4800000 INFO (zkConnectionManagerCallback-65746-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4800187 INFO (zkConnectionManagerCallback-65748-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4800403 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4800403 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43508_solr
[junit4] 2> 4800404 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.Overseer Overseer (id=72939468182454280-127.0.0.1:43508_solr-n_0000000000) starting
[junit4] 2> 4800472 INFO (jetty-launcher-65715-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
[junit4] 2> 4800493 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4800493 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42621_solr
[junit4] 2> 4800508 INFO (zkConnectionManagerCallback-65754-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4800549 INFO (zkCallback-65737-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4800569 INFO (zkCallback-65747-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4800642 INFO (zkConnectionManagerCallback-65759-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4800662 INFO (zkConnectionManagerCallback-65761-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4800715 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4801142 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
[junit4] 2> 4801257 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 4801259 INFO (zkConnectionManagerCallback-65768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4801275 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4801275 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 4801275 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43508_solr
[junit4] 2> 4801277 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 4801277 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 4801277 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 4801294 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
[junit4] 2> 4801296 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 4801389 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 4801423 INFO (zkCallback-65747-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4801460 INFO (zkCallback-65767-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4801478 INFO (zkCallback-65737-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4801478 INFO (zkCallback-65758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4801609 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4801622 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:42621_solr, 127.0.0.1:43508_solr]
[junit4] 2> 4801623 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 4801691 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 4801712 DEBUG (OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 4801858 DEBUG (ScheduledTrigger-12671-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 4801865 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4801874 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 4801953 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 4801953 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40769_solr
[junit4] 2> 4801969 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4801969 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4801970 INFO (jetty-launcher-65715-thread-1) [n:127.0.0.1:42621_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/.
[junit4] 2> 4801972 INFO (zkCallback-65767-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4801972 INFO (zkCallback-65747-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4802025 INFO (zkCallback-65737-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4801990 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4802025 INFO (zkCallback-65760-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4802062 INFO (zkCallback-65758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4802064 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4802114 INFO (zkCallback-65735-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4802122 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4802122 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4802135 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 4802135 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38417_solr
[junit4] 2> 4802188 INFO (zkCallback-65747-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802188 INFO (zkCallback-65760-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802188 INFO (zkCallback-65735-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802189 INFO (zkCallback-65737-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802191 INFO (zkCallback-65758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802191 INFO (zkCallback-65767-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4802192 INFO (jetty-launcher-65715-thread-4) [n:127.0.0.1:43508_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/.
[junit4] 2> 4802391 INFO (zkConnectionManagerCallback-65776-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4802411 INFO (zkConnectionManagerCallback-65780-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4802464 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4802485 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4802537 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
[junit4] 2> 4802574 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 4802700 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
[junit4] 2> 4802720 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 4802993 DEBUG (ScheduledTrigger-12671-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4803033 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803145 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803284 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803284 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803358 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803358 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4803376 INFO (jetty-launcher-65715-thread-3) [n:127.0.0.1:40769_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/.
[junit4] 2> 4803473 INFO (jetty-launcher-65715-thread-2) [n:127.0.0.1:38417_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/.
[junit4] 2> 4803852 INFO (zkConnectionManagerCallback-65784-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4803878 INFO (zkConnectionManagerCallback-65789-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 4803920 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 4803922 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
[junit4] 2> 4804086 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4804490 INFO (TEST-TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes-seed#[ED62F88457D8A0A3]) [ ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionWithDownNodes
[junit4] 2> 4804518 INFO (qtp1578527410-139817) [n:127.0.0.1:42621_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=3&name=halfdeletedcollection2&nrtReplicas=3&action=CREATE&numShards=4&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4804547 INFO (OverseerThreadFactory-12673-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection halfdeletedcollection2
[junit4] 2> 4804695 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfdeletedcollection2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43508/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804730 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfdeletedcollection2_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40769/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804767 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfdeletedcollection2_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38417/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804769 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"halfdeletedcollection2_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42621/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804824 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"halfdeletedcollection2_shard2_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43508/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804826 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"halfdeletedcollection2_shard2_replica_n10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40769/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804859 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"halfdeletedcollection2_shard3_replica_n12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38417/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804863 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"halfdeletedcollection2_shard3_replica_n14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42621/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804898 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"halfdeletedcollection2_shard3_replica_n17",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43508/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804914 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"halfdeletedcollection2_shard4_replica_n18",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40769/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804933 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"halfdeletedcollection2_shard4_replica_n20",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38417/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4804935 INFO (OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfdeletedcollection2",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"halfdeletedcollection2_shard4_replica_n22",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42621/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 4805091 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4805201 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr x:halfdeletedcollection2_shard1_replica_n3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n3&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805255 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr x:halfdeletedcollection2_shard4_replica_n18] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n18&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805255 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr x:halfdeletedcollection2_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n1&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805256 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr x:halfdeletedcollection2_shard3_replica_n14] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n14&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805256 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 4805257 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr x:halfdeletedcollection2_shard2_replica_n10] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n10&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805257 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr x:halfdeletedcollection2_shard4_replica_n22] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node24&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n22&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805384 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr x:halfdeletedcollection2_shard1_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n4&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805531 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr x:halfdeletedcollection2_shard2_replica_n8] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n8&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805532 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr x:halfdeletedcollection2_shard3_replica_n17] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n17&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805533 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr x:halfdeletedcollection2_shard4_replica_n20] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node23&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n20&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805550 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr x:halfdeletedcollection2_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n6&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4805562 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr x:halfdeletedcollection2_shard3_replica_n12] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n12&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4806094 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4806315 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4806482 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.IndexSchema [halfdeletedcollection2_shard1_replica_n3] Schema name=minimal
[junit4] 2> 4806518 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4806518 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard1_replica_n3' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4806519 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard1.replica_n3' (registry 'solr.core.halfdeletedcollection2.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4806519 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4806519 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore [[halfdeletedcollection2_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard1_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard1_replica_n3/data/]
[junit4] 2> 4807374 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4807466 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807482 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807502 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807536 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807611 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807556 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807626 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807675 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.s.IndexSchema [halfdeletedcollection2_shard1_replica_n1] Schema name=minimal
[junit4] 2> 4807685 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4807692 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4807692 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard1_replica_n1' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4807692 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard1.replica_n1' (registry 'solr.core.halfdeletedcollection2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4807692 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4807692 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrCore [[halfdeletedcollection2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard1_replica_n1/data/]
[junit4] 2> 4807700 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.s.IndexSchema [halfdeletedcollection2_shard3_replica_n12] Schema name=minimal
[junit4] 2> 4808029 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4808048 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808048 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard3_replica_n12' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808049 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard3.replica_n12' (registry 'solr.core.halfdeletedcollection2.shard3.replica_n12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808049 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808049 INFO (qtp837502291-139803) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard3 r:core_node15 x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrCore [[halfdeletedcollection2_shard3_replica_n12] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard3_replica_n12], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard3_replica_n12/data/]
[junit4] 2> 4808057 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4808077 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4808095 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.s.IndexSchema [halfdeletedcollection2_shard4_replica_n22] Schema name=minimal
[junit4] 2> 4808098 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.s.IndexSchema [halfdeletedcollection2_shard1_replica_n4] Schema name=minimal
[junit4] 2> 4808121 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.s.IndexSchema [halfdeletedcollection2_shard2_replica_n10] Schema name=minimal
[junit4] 2> 4808123 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808123 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard2_replica_n10' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808124 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard2.replica_n10' (registry 'solr.core.halfdeletedcollection2.shard2.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808124 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808124 INFO (qtp1110224962-139794) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrCore [[halfdeletedcollection2_shard2_replica_n10] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard2_replica_n10], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard2_replica_n10/data/]
[junit4] 2> 4808158 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.s.IndexSchema [halfdeletedcollection2_shard4_replica_n20] Schema name=minimal
[junit4] 2> 4808160 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808160 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard4_replica_n20' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808160 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard4.replica_n20' (registry 'solr.core.halfdeletedcollection2.shard4.replica_n20') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808160 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808161 INFO (qtp837502291-139810) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard4 r:core_node23 x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrCore [[halfdeletedcollection2_shard4_replica_n20] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard4_replica_n20], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard4_replica_n20/data/]
[junit4] 2> 4808169 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808169 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard1_replica_n4' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808170 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard1.replica_n4' (registry 'solr.core.halfdeletedcollection2.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808170 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808170 INFO (qtp837502291-139808) [n:127.0.0.1:38417_solr c:halfdeletedcollection2 s:shard1 r:core_node7 x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrCore [[halfdeletedcollection2_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard1_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard1_replica_n4/data/]
[junit4] 2> 4808173 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.s.IndexSchema [halfdeletedcollection2_shard4_replica_n18] Schema name=minimal
[junit4] 2> 4808482 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4808528 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808528 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard4_replica_n22' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808529 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard4.replica_n22' (registry 'solr.core.halfdeletedcollection2.shard4.replica_n22') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808529 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808529 INFO (qtp1578527410-139812) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrCore [[halfdeletedcollection2_shard4_replica_n22] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard4_replica_n22], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard4_replica_n22/data/]
[junit4] 2> 4808564 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808564 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard4_replica_n18' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808564 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard4.replica_n18' (registry 'solr.core.halfdeletedcollection2.shard4.replica_n18') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808564 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808564 INFO (qtp1110224962-139795) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrCore [[halfdeletedcollection2_shard4_replica_n18] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard4_replica_n18], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard4_replica_n18/data/]
[junit4] 2> 4808582 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.s.IndexSchema [halfdeletedcollection2_shard3_replica_n14] Schema name=minimal
[junit4] 2> 4808602 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.s.IndexSchema [halfdeletedcollection2_shard2_replica_n6] Schema name=minimal
[junit4] 2> 4808618 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.s.IndexSchema [halfdeletedcollection2_shard3_replica_n17] Schema name=minimal
[junit4] 2> 4808620 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808620 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard3_replica_n17' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808637 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard3.replica_n17' (registry 'solr.core.halfdeletedcollection2.shard3.replica_n17') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808637 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808637 INFO (qtp1121055659-139822) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard3 r:core_node19 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrCore [[halfdeletedcollection2_shard3_replica_n17] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard3_replica_n17], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard3_replica_n17/data/]
[junit4] 2> 4808690 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808690 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard3_replica_n14' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808690 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard3.replica_n14' (registry 'solr.core.halfdeletedcollection2.shard3.replica_n14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808691 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808691 INFO (qtp1578527410-139813) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard3 r:core_node16 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrCore [[halfdeletedcollection2_shard3_replica_n14] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard3_replica_n14], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard3_replica_n14/data/]
[junit4] 2> 4808711 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.s.IndexSchema [halfdeletedcollection2_shard2_replica_n8] Schema name=minimal
[junit4] 2> 4808713 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808713 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard2_replica_n8' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808713 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard2.replica_n8' (registry 'solr.core.halfdeletedcollection2.shard2.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808713 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808713 INFO (qtp1121055659-139827) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard2 r:core_node11 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrCore [[halfdeletedcollection2_shard2_replica_n8] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard2_replica_n8], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard2_replica_n8/data/]
[junit4] 2> 4808747 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 4808748 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'halfdeletedcollection2_shard2_replica_n6' using configuration from collection halfdeletedcollection2, trusted=true
[junit4] 2> 4808748 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard2.replica_n6' (registry 'solr.core.halfdeletedcollection2.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
[junit4] 2> 4808748 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4808748 INFO (qtp1578527410-139815) [n:127.0.0.1:42621_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrCore [[halfdeletedcollection2_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard2_replica_n6/data/]
[junit4] 2> 4809469 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4809469 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4809470 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4809805 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4809807 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@471e7fc7[halfdeletedcollection2_shard1_replica_n3] main]
[junit4] 2> 4809826 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 4809826 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 4809827 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 4809827 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1605494578470715392
[junit4] 2> 4809841 INFO (searcherExecutor-12689-thread-1-processing-n:127.0.0.1:40769_solr x:halfdeletedcollection2_shard1_replica_n3 c:halfdeletedcollection2 s:shard1 r:core_node5) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore [halfdeletedcollection2_shard1_replica_n3] Registered new searcher Searcher@471e7fc7[halfdeletedcollection2_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4809848 DEBUG (ScheduledTrigger-12671-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
[junit4] 2> 4809981 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4809981 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4809982 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4809982 INFO (qtp1121055659-139826) [n:127.0.0.1:43508_solr c:halfdeletedcollection2 s:shard1 r:core_node2 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4810008 INFO (qtp1110224962-139799) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 r:core
[...truncated too long message...]
lteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 40parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 14parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 20parent_f2_s=Lucene50(blocksize=128), 34parent_f1_s=Lucene50(blocksize=128), 24parent_f1_s=FST50, 30parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 5parent_f1_s=Lucene50(blocksize=128), 6grand0_s=FST50, 10parent_f2_s=FST50, 8parent_f1_s=FST50, 27parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 2parent_f2_s=Lucene50(blocksize=128), 4child1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 2grand1_s=Lucene50(blocksize=128), 17parent_f2_s=Lucene50(blocksize=128), 3child2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 16parent_f2_s=FST50, 26parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 1child0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 36parent_f2_s=FST50, 7grand6_s=PostingsFormat(name=LuceneVarGapFixedInterval), 5grand0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 18parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 28parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 6grand5_s=Lucene50(blocksize=128), 7grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 15parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 4grand3_s=Lucene50(blocksize=128), 6parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 25parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 0parent_f1_s=FST50, 3grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 35parent_f1_s=FST50, 4parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 19parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 37parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 5grand4_s=PostingsFormat(name=LuceneVarGapFixedInterval), 38parent_f1_s=Lucene50(blocksize=128), 6grand1_s=Lucene50(blocksize=128), 5parent_f2_s=FST50, 16parent_f1_s=Lucene50(blocksize=128), 8parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 39parent_f2_s=Lucene50(blocksize=128), 29parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 2parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 4child2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), rnd_b=Lucene50(blocksize=128), 27parent_f1_s=Lucene50(blocksize=128), 17parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 2grand0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 3child1_s=FST50, 7parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 26parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 2child0_s=FST50, 3parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 36parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{_version_=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Asserting), text_t=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=574, maxMBSortInHeap=6.466847940740896, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@31efb2d9), locale=sq-AL, timezone=Europe/Riga
[junit4] 2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=4,threads=133,free=37266040,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [TestSystemIdResolver, LIRRollingUpdatesTest, TestSolrCloudWithHadoopAuthPlugin, TestSimpleTrackingShardHandler, DirectUpdateHandlerTest, TestInfoStreamLogging, HdfsDirectoryTest, TestRawTransformer, MultiThreadedOCPTest, CollectionsAPIDistributedZkTest, CollectionReloadTest, TestBadConfig, SliceStateTest, TestCorePropertiesReload, TestSQLHandlerNonCloud, TestShardHandlerFactory, TestPayloadCheckQParserPlugin, TestTrackingShardHandlerFactory, ScheduledTriggerTest, TestChildDocTransformer, TestLegacyNumericUtils, TestSSLRandomization, CoreAdminRequestStatusTest, TestStressLucene, HdfsChaosMonkeySafeLeaderTest, TestPHPSerializedResponseWriter, DocumentAnalysisRequestHandlerTest, TestSolrCoreSnapshots, TestNumericRangeQuery32, TestGeoJSONResponseWriter, IgnoreLargeDocumentProcessorFactoryTest, ZkShardTermsTest, XmlUpdateRequestHandlerTest, TestManagedStopFilterFactory, ClassificationUpdateProcessorTest, BitVectorTest, JSONWriterTest, DeleteInactiveReplicaTest, DistributedFacetPivotLargeTest, TestPostingsSolrHighlighter, SpatialFilterTest, OverriddenZkACLAndCredentialsProvidersTest, QueryEqualityTest, MetricsHandlerTest, TestScoreJoinQPScore, DateFieldTest, MetricUtilsTest, FileUtilsTest, TestCollectionAPI, AnalyticsMergeStrategyTest, SpatialHeatmapFacetsTest, TestLazyCores, DistribCursorPagingTest, LeaderElectionTest, ShufflingReplicaListTransformerTest, PrimUtilsTest, ZkControllerTest, HttpTriggerListenerTest, BlockJoinFacetRandomTest, TestConfigOverlay, TestEmbeddedSolrServerAdminHandler, DocExpirationUpdateProcessorFactoryTest, BlobRepositoryCloudTest, ConnectionManagerTest, TestDocTermOrdsUninvertLimit, HdfsThreadLeakTest, HdfsWriteToMultipleCollectionsTest, TestRestManager, DistributedQueryComponentCustomSortTest, DistributedQueueTest, TestExactSharedStatsCache, TestLeaderElectionZkExpiry, TestJsonFacetsWithNestedObjects, TestHalfAndHalfDocValues, TestLegacyNumericRangeQueryBuilder, NodeLostTriggerIntegrationTest, SuggesterFSTTest, TestRandomCollapseQParserPlugin, TestInPlaceUpdatesStandalone, HighlighterConfigTest, TestCloudConsistency, DistanceFunctionTest, CleanupOldIndexTest, TestCloudSchemaless, PeerSyncTest, TestFieldResource, DirectSolrConnectionTest, TestConfigSets, TestNumericTerms64, TestQueryTypes, CollectionsAPISolrJTest, MigrateRouteKeyTest, SolrJmxReporterCloudTest, CdcrRequestHandlerTest, TestFuzzyAnalyzedSuggestions, TestSchemaManager, TestSolrQueryParser, TestDynamicLoading, SecurityConfHandlerTest, TestSchemaVersionResource, SolrCoreCheckLockOnStartupTest, PluginInfoTest, TestDFISimilarityFactory, TestSolrCoreParser, FacetPivotSmallTest, TestTolerantUpdateProcessorCloud, TestMultiWordSynonyms, TestHdfsBackupRestoreCore, TestConfigSetsAPIZkFailure, TestComplexPhraseLeadingWildcard, ConvertedLegacyTest, ReplicaListTransformerTest, TermVectorComponentTest, TestDocumentBuilder, PeerSyncWithLeaderAndIndexFingerprintCachingTest, SolrXmlInZkTest, TestTriggerIntegration, ShardRoutingCustomTest, RequestHandlersTest, TestBinaryField, RollingRestartTest, TestReRankQParserPlugin, SolrIndexSplitterTest, TestCSVResponseWriter, AnalysisErrorHandlingTest, MoveReplicaHDFSTest, NumericFieldsTest, AsyncCallRequestStatusResponseTest, TestAuthorizationFramework, TestNodeLostTrigger, TestSubQueryTransformerDistrib, RestoreTriggerStateTest, BadComponentTest, RegexBoostProcessorTest, TestFastOutputStream, CursorPagingTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, EchoParamsTest, MinimalSchemaTest, OutputWriterTest, SampleTest, SolrInfoBeanTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestGroupingSearch, TestHighlightDedupGrouping, TestJoin, TestSolrCoreProperties, TestTolerantSearch, TestTrie, PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, TestCharFilters, TestLuceneMatchVersion, TestReversedWildcardFilterFactory, TestWordDelimiterFilterFactory, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, ActionThrottleTest, AddReplicaTest, BasicDistributedZk2Test, BasicDistributedZkTest, BasicZkTest, ChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderTest, DocValuesNotIndexedTest, ForceLeaderTest, FullSolrCloudDistribCmdsTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=ED62F88457D8A0A3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt -Dtests.locale=sq-AL -Dtests.timezone=Europe/Riga -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | FullSolrCloudDistribCmdsTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)
[junit4] Completed [822/822 (3!)] on J2 in 8369.95s, 1 test, 2 errors <<< FAILURES!
[...truncated 1 lines...]
[junit4] JVM J2: stdout was not empty, see: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J2-20180709_052854_0328821182303940527471.sysout
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid17717.hprof ...
[junit4] Heap dump file created [574979098 bytes in 19.502 secs]
[junit4] <<< JVM J2: EOF ----
[...truncated 8720 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid17717.hprof
Total time: 629 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any