You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/10/02 00:17:57 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4201
- Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4201/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
4 tests failed.
FAILED: org.apache.solr.cloud.CustomCollectionTest.testCreateShardRepFactor
Error Message:
Error from server at http://127.0.0.1:62639/solr: Could not find collection : testCreateShardRepFactor
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:62639/solr: Could not find collection : testCreateShardRepFactor
at __randomizedtesting.SeedInfo.seed([BCA5BACE483D0AA6:484B304A50691F66]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.CustomCollectionTest.testCreateShardRepFactor(CustomCollectionTest.java:190)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([BCA5BACE483D0AA6:34F18514E6C1675E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:908)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
Error Message:
Can not find doc 1 in http://127.0.0.1:58550/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 1 in http://127.0.0.1:58550/solr
at __randomizedtesting.SeedInfo.seed([BCA5BACE483D0AA6:3A644223176CDC46]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:861)
at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:664)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([BCA5BACE483D0AA6:A0A4C7433D987435]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:490)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11728 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> 539207 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/init-core-data-001
[junit4] 2> 539208 WARN (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 539208 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 539212 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 539213 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001
[junit4] 2> 539213 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 539213 INFO (Thread-866) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 539213 INFO (Thread-866) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 539217 ERROR (Thread-866) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 539323 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:58544
[junit4] 2> 539349 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15eda31238b0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 539350 INFO (jetty-launcher-614-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 539350 INFO (jetty-launcher-614-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 539353 INFO (jetty-launcher-614-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c8a9850{/solr,null,AVAILABLE}
[junit4] 2> 539353 INFO (jetty-launcher-614-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5b8a9ae9{/solr,null,AVAILABLE}
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@69873aaf{HTTP/1.1,[http/1.1]}{127.0.0.1:58550}
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-2) [ ] o.e.j.s.Server Started @543069ms
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58550}
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4d82b77d{HTTP/1.1,[http/1.1]}{127.0.0.1:58551}
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-1) [ ] o.e.j.s.Server Started @543070ms
[junit4] 2> 539354 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58551}
[junit4] 2> 539355 ERROR (jetty-launcher-614-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 539355 ERROR (jetty-launcher-614-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-01T23:06:47.190Z
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 539355 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 539356 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 539356 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-01T23:06:47.191Z
[junit4] 2> 539359 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 539360 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 539368 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15eda31238b0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 539369 INFO (jetty-launcher-614-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58544/solr
[junit4] 2> 539371 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15eda31238b0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 539373 INFO (jetty-launcher-614-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58544/solr
[junit4] 2> 539378 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15eda31238b0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 539521 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 539521 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 539522 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58550_solr
[junit4] 2> 539523 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58551_solr
[junit4] 2> 539523 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.c.Overseer Overseer (id=98756146433294342-127.0.0.1:58550_solr-n_0000000000) starting
[junit4] 2> 539524 INFO (zkCallback-625-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 539525 INFO (zkCallback-626-thread-1-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 539535 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58550_solr
[junit4] 2> 539545 INFO (zkCallback-626-thread-1-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 539546 INFO (zkCallback-625-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 539635 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539640 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539646 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539646 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539647 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539648 INFO (jetty-launcher-614-thread-2) [n:127.0.0.1:58550_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/.
[junit4] 2> 539648 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 539651 INFO (jetty-launcher-614-thread-1) [n:127.0.0.1:58551_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/.
[junit4] 2> 539702 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15eda31238b0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 539709 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 539711 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58544/solr ready
[junit4] 2> 539716 INFO (SUITE-TestTlogReplica-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 539720 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 539728 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 539749 INFO (TEST-TestTlogReplica.testCreateDelete-seed#[BCA5BACE483D0AA6]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateDelete {seed=[BCA5BACE483D0AA6:A7B54B82BECDF296]}
[junit4] 2> 539752 INFO (qtp1418184739-4378) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_create_delete&action=CREATE&numShards=2&tlogReplicas=4 and sendToOCPQueue=true
[junit4] 2> 539755 INFO (OverseerThreadFactory-1575-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_create_delete
[junit4] 2> 539756 WARN (OverseerThreadFactory-1575-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 4 on collection tlog_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 539877 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58550/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539882 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58551/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539887 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58550/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539891 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard1_replica_t6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58551/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539896 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58550/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539901 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58551/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539906 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t12",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58550/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 539910 INFO (OverseerStateUpdate-98756146433294342-127.0.0.1:58550_solr-n_0000000000) [n:127.0.0.1:58550_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"tlog_replica_test_create_delete_shard2_replica_t14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58551/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 540119 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t1&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540120 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t4&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540120 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 540121 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t12&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540121 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t8&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540124 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t6&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540125 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 540125 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard1_replica_t2&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540126 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t10&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540127 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=tlog_replica_test_create_delete_shard2_replica_t14&action=CREATE&numShards=2&collection=tlog_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 540260 INFO (zkCallback-625-thread-2-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540260 INFO (zkCallback-625-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540260 INFO (zkCallback-626-thread-1-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 540260 INFO (zkCallback-626-thread-2-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541156 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541157 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541162 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541169 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541171 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541175 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541177 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541177 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 541187 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t1] Schema name=minimal
[junit4] 2> 541188 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t8] Schema name=minimal
[junit4] 2> 541188 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t14] Schema name=minimal
[junit4] 2> 541191 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541191 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541191 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t14' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541191 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t1' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541191 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.core.tlog_replica_test_create_delete.shard2.replica_t14' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541192 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541192 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.core.tlog_replica_test_create_delete.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541192 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t14] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/tlog_replica_test_create_delete_shard2_replica_t14], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard2_replica_t14/data/]
[junit4] 2> 541193 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t4] Schema name=minimal
[junit4] 2> 541193 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t10] Schema name=minimal
[junit4] 2> 541194 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t6] Schema name=minimal
[junit4] 2> 541195 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541195 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t4' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541195 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541195 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t10' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541195 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.core.tlog_replica_test_create_delete.shard1.replica_t4' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541195 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541195 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/tlog_replica_test_create_delete_shard1_replica_t4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard1_replica_t4/data/]
[junit4] 2> 541195 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.core.tlog_replica_test_create_delete.shard2.replica_t10' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541191 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541195 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541195 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t8' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541195 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t10] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/tlog_replica_test_create_delete_shard2_replica_t10], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard2_replica_t10/data/]
[junit4] 2> 541196 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.core.tlog_replica_test_create_delete.shard2.replica_t8' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541196 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541196 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t6' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541196 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541196 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t8] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/tlog_replica_test_create_delete_shard2_replica_t8], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard2_replica_t8/data/]
[junit4] 2> 541196 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.core.tlog_replica_test_create_delete.shard1.replica_t6' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541196 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541196 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/tlog_replica_test_create_delete_shard1_replica_t6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard1_replica_t6/data/]
[junit4] 2> 541192 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541197 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/tlog_replica_test_create_delete_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard1_replica_t1/data/]
[junit4] 2> 541200 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard1_replica_t2] Schema name=minimal
[junit4] 2> 541201 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.IndexSchema [tlog_replica_test_create_delete_shard2_replica_t12] Schema name=minimal
[junit4] 2> 541202 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541202 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard1_replica_t2' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541202 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 541202 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_create_delete_shard2_replica_t12' using configuration from collection tlog_replica_test_create_delete, trusted=true
[junit4] 2> 541202 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58551.solr.core.tlog_replica_test_create_delete.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_create_delete.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541202 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541202 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/tlog_replica_test_create_delete_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node1/./tlog_replica_test_create_delete_shard1_replica_t2/data/]
[junit4] 2> 541203 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_58550.solr.core.tlog_replica_test_create_delete.shard2.replica_t12' (registry 'solr.core.tlog_replica_test_create_delete.shard2.replica_t12') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e54e9cf
[junit4] 2> 541203 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 541203 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore [[tlog_replica_test_create_delete_shard2_replica_t12] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/tlog_replica_test_create_delete_shard2_replica_t12], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_BCA5BACE483D0AA6-001/tempDir-001/node2/./tlog_replica_test_create_delete_shard2_replica_t12/data/]
[junit4] 2> 541302 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541302 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541304 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541304 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541308 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.s.SolrIndexSearcher Opening [Searcher@4325d0f[tlog_replica_test_create_delete_shard1_replica_t6] main]
[junit4] 2> 541313 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541314 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541314 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541315 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345133670400
[junit4] 2> 541316 INFO (searcherExecutor-1585-thread-1-processing-n:127.0.0.1:58551_solr x:tlog_replica_test_create_delete_shard1_replica_t6 s:shard1 c:tlog_replica_test_create_delete r:core_node9) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t6] Registered new searcher Searcher@4325d0f[tlog_replica_test_create_delete_shard1_replica_t6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541327 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=4 found=1 timeoutin=9999ms
[junit4] 2> 541334 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541334 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541335 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541335 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541337 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541337 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541340 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@d1a8640[tlog_replica_test_create_delete_shard1_replica_t2] main]
[junit4] 2> 541341 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541342 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541342 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541342 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541343 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541344 INFO (qtp76965383-4381) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345164079104
[junit4] 2> 541345 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541345 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541348 INFO (searcherExecutor-1586-thread-1-processing-n:127.0.0.1:58551_solr x:tlog_replica_test_create_delete_shard1_replica_t2 s:shard1 c:tlog_replica_test_create_delete r:core_node5) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node5 x:tlog_replica_test_create_delete_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t2] Registered new searcher Searcher@d1a8640[tlog_replica_test_create_delete_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541349 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541350 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541351 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.s.SolrIndexSearcher Opening [Searcher@5380d80[tlog_replica_test_create_delete_shard2_replica_t12] main]
[junit4] 2> 541356 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.s.SolrIndexSearcher Opening [Searcher@65345ddb[tlog_replica_test_create_delete_shard2_replica_t14] main]
[junit4] 2> 541357 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541358 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541358 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541358 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345178759168
[junit4] 2> 541359 INFO (searcherExecutor-1580-thread-1-processing-n:127.0.0.1:58551_solr x:tlog_replica_test_create_delete_shard2_replica_t14 s:shard2 c:tlog_replica_test_create_delete r:core_node16) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t14] Registered new searcher Searcher@65345ddb[tlog_replica_test_create_delete_shard2_replica_t14] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541361 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541362 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541362 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541362 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541374 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541374 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541374 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541374 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541375 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541375 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541376 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541377 INFO (searcherExecutor-1587-thread-1-processing-n:127.0.0.1:58550_solr x:tlog_replica_test_create_delete_shard2_replica_t12 s:shard2 c:tlog_replica_test_create_delete r:core_node15) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t12] Registered new searcher Searcher@5380d80[tlog_replica_test_create_delete_shard2_replica_t12] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541377 INFO (qtp76965383-4385) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node16 x:tlog_replica_test_create_delete_shard2_replica_t14] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=4 found=1 timeoutin=9999ms
[junit4] 2> 541377 INFO (qtp1418184739-4372) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node15 x:tlog_replica_test_create_delete_shard2_replica_t12] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345198682112
[junit4] 2> 541380 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541380 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541381 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541381 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541382 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b193615[tlog_replica_test_create_delete_shard2_replica_t8] main]
[junit4] 2> 541383 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.s.SolrIndexSearcher Opening [Searcher@755658a1[tlog_replica_test_create_delete_shard2_replica_t10] main]
[junit4] 2> 541384 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541384 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541384 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541384 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541384 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541385 INFO (qtp1418184739-4376) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345207070720
[junit4] 2> 541385 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541386 INFO (searcherExecutor-1584-thread-1-processing-n:127.0.0.1:58550_solr x:tlog_replica_test_create_delete_shard2_replica_t8 s:shard2 c:tlog_replica_test_create_delete r:core_node11) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard2 r:core_node11 x:tlog_replica_test_create_delete_shard2_replica_t8] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t8] Registered new searcher Searcher@2b193615[tlog_replica_test_create_delete_shard2_replica_t8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541386 INFO (searcherExecutor-1583-thread-1-processing-n:127.0.0.1:58551_solr x:tlog_replica_test_create_delete_shard2_replica_t10 s:shard2 c:tlog_replica_test_create_delete r:core_node13) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard2_replica_t10] Registered new searcher Searcher@755658a1[tlog_replica_test_create_delete_shard2_replica_t10] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541386 INFO (qtp76965383-4383) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard2 r:core_node13 x:tlog_replica_test_create_delete_shard2_replica_t10] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345208119296
[junit4] 2> 541387 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b427ca1[tlog_replica_test_create_delete_shard1_replica_t4] main]
[junit4] 2> 541389 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541390 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541390 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541391 INFO (searcherExecutor-1582-thread-1-processing-n:127.0.0.1:58550_solr x:tlog_replica_test_create_delete_shard1_replica_t4 s:shard1 c:tlog_replica_test_create_delete r:core_node7) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t4] Registered new searcher Searcher@6b427ca1[tlog_replica_test_create_delete_shard1_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541391 INFO (qtp1418184739-4382) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node7 x:tlog_replica_test_create_delete_shard1_replica_t4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345213362176
[junit4] 2> 541401 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 541401 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 541402 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 541403 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 541403 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3000b300[tlog_replica_test_create_delete_shard1_replica_t1] main]
[junit4] 2> 541405 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 541405 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 541406 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 541406 INFO (qtp1418184739-4380) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580098345229090816
[junit4] 2> 541406 INFO (searcherExecutor-1581-thread-1-processing-n:127.0.0.1:58550_solr x:tlog_replica_test_create_delete_shard1_replica_t1 s:shard1 c:tlog_replica_test_create_delete r:core_node3) [n:127.0.0.1:58550_solr c:tlog_replica_test_create_delete s:shard1 r:core_node3 x:tlog_replica_test_create_delete_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_create_delete_shard1_replica_t1] Registered new searcher Searcher@3000b300[tlog_replica_test_create_delete_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 541481 INFO (zkCallback-626-thread-2-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541482 INFO (zkCallback-626-thread-1-processing-n:127.0.0.1:58551_solr) [n:127.0.0.1:58551_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541482 INFO (zkCallback-625-thread-2-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541482 INFO (zkCallback-625-thread-1-processing-n:127.0.0.1:58550_solr) [n:127.0.0.1:58550_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_create_delete/state.json] for collection [tlog_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 541838 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 541838 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 541838 INFO (qtp76965383-4373) [n:127.0.0.1:58551_solr c:tlog_replica_test_create_delete s:shard1 r:core_node9 x:tlog_replica_test_create_delete_shard1_replica_t6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58551/solr/tlog_replica_test_create_delete_shard1_replica_t6/
[junit4] 2> 541839 INFO (qtp7
[...truncated too long message...]
read-2-processing-n:127.0.0.1:62638_solr) [n:127.0.0.1:62638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1357004 WARN (zkCallback-1284-thread-3-processing-n:127.0.0.1:62637_solr) [n:127.0.0.1:62637_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1357005 INFO (jetty-closer-1263-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9289d32{/solr,null,UNAVAILABLE}
[junit4] 2> 1357006 INFO (zkCallback-1281-thread-2-processing-n:127.0.0.1:62638_solr) [n:127.0.0.1:62638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1357006 INFO (zkCallback-1282-thread-2-processing-n:127.0.0.1:62639_solr) [n:127.0.0.1:62639_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62639_solr
[junit4] 2> 1357006 INFO (zkCallback-1282-thread-1-processing-n:127.0.0.1:62639_solr) [n:127.0.0.1:62639_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1357007 INFO (jetty-closer-1263-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1357007 INFO (jetty-closer-1263-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26bc2ed0: rootName = solr_62639, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4992c48f
[junit4] 2> 1357007 INFO (jetty-closer-1263-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1357008 INFO (jetty-closer-1263-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@564c1a95: rootName = solr_62638, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4992c48f
[junit4] 2> 1357016 INFO (jetty-closer-1263-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1357016 INFO (jetty-closer-1263-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@317dc203: rootName = solr_62638, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@35458c7d
[junit4] 2> 1357016 INFO (jetty-closer-1263-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1357016 INFO (jetty-closer-1263-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@47ba1f79: rootName = solr_62639, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@35458c7d
[junit4] 2> 1357018 INFO (jetty-closer-1263-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1357018 INFO (jetty-closer-1263-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1357020 WARN (zkCallback-1281-thread-2-processing-n:127.0.0.1:62638_solr) [n:127.0.0.1:62638_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1357021 INFO (jetty-closer-1263-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7f4de2e5{/solr,null,UNAVAILABLE}
[junit4] 2> 1357021 INFO (zkCallback-1282-thread-2-processing-n:127.0.0.1:62639_solr) [n:127.0.0.1:62639_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1357021 WARN (zkCallback-1282-thread-2-processing-n:127.0.0.1:62639_solr) [n:127.0.0.1:62639_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1357022 INFO (jetty-closer-1263-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@65281440{/solr,null,UNAVAILABLE}
[junit4] 2> 1357023 ERROR (SUITE-CustomCollectionTest-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1357023 INFO (SUITE-CustomCollectionTest-seed#[BCA5BACE483D0AA6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62634 62634
[junit4] 2> 1357157 INFO (Thread-1263) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62634 62634
[junit4] 2> 1357367 WARN (Thread-1263) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/configs/conf
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 2 /solr/collections/testCreateShardRepFactor/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 84 /solr/collections/implicitcoll/state.json
[junit4] 2> 24 /solr/collections/routeFieldColl/state.json
[junit4] 2> 24 /solr/collections/withShardField/state.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/testCreateShardRepFactor/state.json
[junit4] 2> 2 /solr/collections/implicitcoll/leader_elect/a/election/98756196481630218-core_node9-n_0000000000
[junit4] 2> 2 /solr/collections/implicitcoll/leader_elect/a/election/98756196481630217-core_node7-n_0000000001
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/c/election/98756196481630219-core_node17-n_0000000000
[junit4] 2> 2 /solr/collections/implicitcoll/leader_elect/c/election/98756196481630220-core_node19-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/collections
[junit4] 2> 9 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_BCA5BACE483D0AA6-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=it-CH, timezone=America/Cayman
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=174465848,total=446693376
[junit4] 2> NOTE: All tests run in this JVM: [DistributedExpandComponentTest, MultiTermTest, TestQuerySenderListener, BasicAuthStandaloneTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DistanceUnitsTest, XmlUpdateRequestHandlerTest, LeaderElectionTest, TestPHPSerializedResponseWriter, CdcrReplicationDistributedZkTest, TestCloudPseudoReturnFields, DocValuesNotIndexedTest, ResourceLoaderTest, TestDownShardTolerantSearch, TestJavabinTupleStreamParser, TestPrepRecovery, TestSimpleQParserPlugin, BlockDirectoryTest, AnalyticsMergeStrategyTest, TestStreamBody, JavabinLoaderTest, TestLazyCores, FacetPivotSmallTest, TestTolerantUpdateProcessorCloud, TestJmxIntegration, TestSweetSpotSimilarityFactory, QueryParsingTest, TestManagedResource, CdcrRequestHandlerTest, RulesTest, HealthCheckHandlerTest, TestUninvertingReader, ClassificationUpdateProcessorIntegrationTest, UtilsToolTest, TestSubQueryTransformerCrossCore, TestSizeLimitedDistributedMap, OutOfBoxZkACLAndCredentialsProvidersTest, TestReloadDeadlock, AnalysisErrorHandlingTest, LeaderElectionContextKeyTest, TestFieldCacheSortRandom, TestReversedWildcardFilterFactory, TestSolrConfigHandlerConcurrent, SortByFunctionTest, DistributedFacetPivotLargeTest, ConfigureRecoveryStrategyTest, HdfsRestartWhileUpdatingTest, HighlighterTest, TestBinaryField, ShardRoutingTest, TimeZoneUtilsTest, TestObjectReleaseTracker, SolrCoreMetricManagerTest, TestDelegationWithHadoopAuth, CircularListTest, TestSort, TestFieldSortValues, TestSortByMinMaxFunction, SimplePostToolTest, SliceStateTest, TestSolr4Spatial2, TestFuzzyAnalyzedSuggestions, TestGeoJSONResponseWriter, TestComplexPhraseQParserPlugin, BasicDistributedZkTest, CoreAdminHandlerTest, SyncSliceTest, HdfsChaosMonkeyNothingIsSafeTest, TestLMDirichletSimilarityFactory, TestStressCloudBlindAtomicUpdates, TestAtomicUpdateErrorCases, BinaryUpdateRequestHandlerTest, TestExpandComponent, TestUseDocValuesAsStored, ConnectionManagerTest, TestEmbeddedSolrServerAdminHandler, CoreMergeIndexesAdminHandlerTest, UUIDFieldTest, TestRandomCollapseQParserPlugin, TestBackupRepositoryFactory, MergeStrategyTest, TestScoreJoinQPNoScore, PrimitiveFieldTypeTest, NoCacheHeaderTest, TestCoreContainer, RestartWhileUpdatingTest, RequiredFieldsTest, TestPullReplicaErrorHandling, XsltUpdateRequestHandlerTest, SecurityConfHandlerTest, RecoveryZkTest, TestMinMaxOnMultiValuedField, TestSolrCloudWithKerberosAlt, TestMaxScoreQueryParser, DirectUpdateHandlerOptimizeTest, TestFaceting, TestRuleBasedAuthorizationPlugin, TestOverriddenPrefixQueryForCustomFieldType, TestQuerySenderNoQuery, TestPayloadScoreQParserPlugin, AtomicUpdatesTest, TestHashPartitioner, TestRetrieveFieldsOptimizer, SolrCLIZkUtilsTest, RegexBoostProcessorTest, MultiThreadedOCPTest, TestChildDocTransformer, TestManagedSchema, UnloadDistributedZkTest, TestUpdate, TestManagedSchemaThreadSafety, TestRequestStatusCollectionAPI, BlockJoinFacetSimpleTest, StatsReloadRaceTest, TolerantUpdateProcessorTest, TestStressUserVersions, AlternateDirectoryTest, CustomCollectionTest]
[junit4] Completed [263/734 (3!)] on J0 in 54.51s, 4 tests, 1 error <<< FAILURES!
[...truncated 48443 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4205
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4205/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 60278 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:669: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:682: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 100 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4204
- Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4204/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4: ClusterState says we are the leader (https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4), but locally we don't think so. Request came from null
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4: ClusterState says we are the leader (https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4), but locally we don't think so. Request came from null
at __randomizedtesting.SeedInfo.seed([6C149846216E6518:2461ECF2275D4A8D]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4: ClusterState says we are the leader (https://127.0.0.1:63888/solr/awhollynewcollection_0_shard3_replica_n4), but locally we don't think so. Request came from null
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Build Log:
[...truncated 11969 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/init-core-data-001
[junit4] 2> 890311 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 890312 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 890317 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 890318 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 890321 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001
[junit4] 2> 890321 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 890321 INFO (Thread-1853) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 890321 INFO (Thread-1853) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 890325 ERROR (Thread-1853) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 890425 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:63881
[junit4] 2> 890467 INFO (jetty-launcher-1882-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 890467 INFO (jetty-launcher-1882-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 890468 INFO (jetty-launcher-1882-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 890470 INFO (jetty-launcher-1882-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2218496c{/solr,null,AVAILABLE}
[junit4] 2> 890473 INFO (jetty-launcher-1882-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 890475 INFO (jetty-launcher-1882-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d911e4b{/solr,null,AVAILABLE}
[junit4] 2> 890476 INFO (jetty-launcher-1882-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e8667c6{/solr,null,AVAILABLE}
[junit4] 2> 890477 INFO (jetty-launcher-1882-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@19493330{SSL,[ssl, http/1.1]}{127.0.0.1:63883}
[junit4] 2> 890477 INFO (jetty-launcher-1882-thread-3) [ ] o.e.j.s.Server Started @893584ms
[junit4] 2> 890477 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63883}
[junit4] 2> 890478 ERROR (jetty-launcher-1882-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2ca6793f{SSL,[ssl, http/1.1]}{127.0.0.1:63885}
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-1) [ ] o.e.j.s.Server Started @893585ms
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63885}
[junit4] 2> 890479 ERROR (jetty-launcher-1882-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 890479 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T08:05:59.342Z
[junit4] 2> 890480 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 890480 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 890480 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 890480 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T08:05:59.343Z
[junit4] 2> 890484 INFO (jetty-launcher-1882-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2a4c597a{SSL,[ssl, http/1.1]}{127.0.0.1:63884}
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.e.j.s.Server Started @893591ms
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63884}
[junit4] 2> 890485 ERROR (jetty-launcher-1882-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 890485 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T08:05:59.348Z
[junit4] 2> 890487 INFO (jetty-launcher-1882-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35def6b6{/solr,null,AVAILABLE}
[junit4] 2> 890491 INFO (jetty-launcher-1882-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5d76075c{SSL,[ssl, http/1.1]}{127.0.0.1:63888}
[junit4] 2> 890491 INFO (jetty-launcher-1882-thread-2) [ ] o.e.j.s.Server Started @893597ms
[junit4] 2> 890491 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63888}
[junit4] 2> 890492 ERROR (jetty-launcher-1882-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 890492 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 890492 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 890492 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 890492 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T08:05:59.355Z
[junit4] 2> 890493 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 890495 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 890498 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 890508 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 890519 INFO (jetty-launcher-1882-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63881/solr
[junit4] 2> 890521 INFO (jetty-launcher-1882-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63881/solr
[junit4] 2> 890542 INFO (jetty-launcher-1882-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63881/solr
[junit4] 2> 890591 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 890593 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63883_solr
[junit4] 2> 890595 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.c.Overseer Overseer (id=98763928973279242-127.0.0.1:63883_solr-n_0000000000) starting
[junit4] 2> 890613 INFO (jetty-launcher-1882-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63881/solr
[junit4] 2> 890617 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63883_solr
[junit4] 2> 890621 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 890637 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15ee1452713000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 890650 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 890654 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 890661 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63884_solr
[junit4] 2> 890663 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 890664 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 890713 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 890716 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 890720 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63888_solr
[junit4] 2> 890721 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 890722 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 890726 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 890735 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 890738 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 890740 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63885_solr
[junit4] 2> 890742 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 890742 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 890742 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 890743 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 890848 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890864 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890901 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890901 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890905 INFO (jetty-launcher-1882-thread-1) [n:127.0.0.1:63885_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node1
[junit4] 2> 890921 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890952 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890952 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890961 INFO (jetty-launcher-1882-thread-3) [n:127.0.0.1:63883_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node3
[junit4] 2> 890968 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890993 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890993 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 890999 INFO (jetty-launcher-1882-thread-4) [n:127.0.0.1:63884_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node4
[junit4] 2> 891006 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 891006 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 891007 INFO (jetty-launcher-1882-thread-2) [n:127.0.0.1:63888_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node2
[junit4] 2> 891125 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 891126 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:63881/solr ready
[junit4] 2> 891160 INFO (TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[6C149846216E6518]) [ ] o.a.s.SolrTestCaseJ4 ###Starting addReplicaTest
[junit4] 2> 891161 INFO (TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[6C149846216E6518]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 891183 INFO (qtp1142627464-10424) [n:127.0.0.1:63885_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=4&name=addReplicaColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 891186 INFO (OverseerThreadFactory-3893-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.CreateCollectionCmd Create collection addReplicaColl
[junit4] 2> 891305 INFO (OverseerStateUpdate-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addReplicaColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"addReplicaColl_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63885/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 891309 INFO (OverseerStateUpdate-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addReplicaColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"addReplicaColl_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63883/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 891314 INFO (OverseerStateUpdate-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addReplicaColl",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"addReplicaColl_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63888/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 891319 INFO (OverseerStateUpdate-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"addReplicaColl",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"addReplicaColl_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63884/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 891550 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 891551 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 891581 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 891581 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 891588 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n6&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 891589 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 891593 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n4&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 891594 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 891717 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891718 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891718 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891718 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891718 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891719 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891720 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 891721 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 892617 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 892642 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n1] Schema name=minimal
[junit4] 2> 892642 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 892646 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 892646 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n1' using configuration from collection addReplicaColl, trusted=true
[junit4] 2> 892646 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard1.replica_n1' (registry 'solr.core.addReplicaColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 892647 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 892647 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node1/addReplicaColl_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node1/addReplicaColl_shard1_replica_n1/data/]
[junit4] 2> 892654 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n2] Schema name=minimal
[junit4] 2> 892666 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 892666 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 892673 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n4] Schema name=minimal
[junit4] 2> 892673 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n6] Schema name=minimal
[junit4] 2> 892691 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 892691 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 892691 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n4' using configuration from collection addReplicaColl, trusted=true
[junit4] 2> 892691 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 892691 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n2' using configuration from collection addReplicaColl, trusted=true
[junit4] 2> 892691 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n6' using configuration from collection addReplicaColl, trusted=true
[junit4] 2> 892691 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard2.replica_n4' (registry 'solr.core.addReplicaColl.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 892691 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard1.replica_n2' (registry 'solr.core.addReplicaColl.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 892691 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard2.replica_n6' (registry 'solr.core.addReplicaColl.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 892692 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 892691 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 892692 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node3/addReplicaColl_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node3/addReplicaColl_shard1_replica_n2/data/]
[junit4] 2> 892692 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node2/addReplicaColl_shard2_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node2/addReplicaColl_shard2_replica_n4/data/]
[junit4] 2> 892692 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 892692 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node4/addReplicaColl_shard2_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node4/addReplicaColl_shard2_replica_n6/data/]
[junit4] 2> 892851 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 892851 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 892852 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 892853 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 892855 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 892855 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 892856 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 892856 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 892856 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 892856 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 892858 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 892858 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 892858 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 892858 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 892859 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 892859 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 892861 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3fda76a[addReplicaColl_shard1_replica_n2] main]
[junit4] 2> 892862 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@a2aa357[addReplicaColl_shard1_replica_n1] main]
[junit4] 2> 892862 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 892863 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 892864 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 892864 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 892865 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 892866 INFO (searcherExecutor-3902-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n1 s:shard1 c:addReplicaColl r:core_node3) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.SolrCore [addReplicaColl_shard1_replica_n1] Registered new searcher Searcher@a2aa357[addReplicaColl_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 892866 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580222866237947904
[junit4] 2> 892868 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 892869 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580222866241093632
[junit4] 2> 892869 INFO (searcherExecutor-3904-thread-1-processing-n:127.0.0.1:63883_solr x:addReplicaColl_shard1_replica_n2 s:shard1 c:addReplicaColl r:core_node5) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SolrCore [addReplicaColl_shard1_replica_n2] Registered new searcher Searcher@3fda76a[addReplicaColl_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 892871 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@76a83366[addReplicaColl_shard2_replica_n4] main]
[junit4] 2> 892872 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@22c215bb[addReplicaColl_shard2_replica_n6] main]
[junit4] 2> 892881 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 892881 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 892881 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 892884 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 892885 INFO (searcherExecutor-3903-thread-1-processing-n:127.0.0.1:63888_solr x:addReplicaColl_shard2_replica_n4 s:shard2 c:addReplicaColl r:core_node7) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SolrCore [addReplicaColl_shard2_replica_n4] Registered new searcher Searcher@76a83366[addReplicaColl_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 892885 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580222866257870848
[junit4] 2> 892885 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 892886 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 892887 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 892887 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580222866259968000
[junit4] 2> 892888 INFO (searcherExecutor-3905-thread-1-processing-n:127.0.0.1:63884_solr x:addReplicaColl_shard2_replica_n6 s:shard2 c:addReplicaColl r:core_node8) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.SolrCore [addReplicaColl_shard2_replica_n6] Registered new searcher Searcher@22c215bb[addReplicaColl_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 892894 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 892894 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 892894 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:63888/solr/addReplicaColl_shard2_replica_n4/
[junit4] 2> 892894 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=addReplicaColl_shard2_replica_n4 url=https://127.0.0.1:63888/solr START replicas=[https://127.0.0.1:63884/solr/addReplicaColl_shard2_replica_n6/] nUpdates=100
[junit4] 2> 892900 INFO (qtp623535642-10417) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.c.S.Request [addReplicaColl_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 893001 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893001 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893205 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=addReplicaColl_shard2_replica_n4 url=https://127.0.0.1:63888/solr DONE. We have no versions. sync failed.
[junit4] 2> 893205 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 893205 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 893205 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 893211 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:63888/solr/addReplicaColl_shard2_replica_n4/ shard2
[junit4] 2> 893329 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893329 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893369 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 893371 INFO (qtp2092496312-10434) [n:127.0.0.1:63888_solr c:addReplicaColl s:shard2 r:core_node7 x:addReplicaColl_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n4&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1778
[junit4] 2> 893391 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 893391 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 893391 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:63883/solr/addReplicaColl_shard1_replica_n2/
[junit4] 2> 893391 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=addReplicaColl_shard1_replica_n2 url=https://127.0.0.1:63883/solr START replicas=[https://127.0.0.1:63885/solr/addReplicaColl_shard1_replica_n1/] nUpdates=100
[junit4] 2> 893397 INFO (qtp1142627464-10408) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.c.S.Request [addReplicaColl_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 893475 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893475 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893693 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=addReplicaColl_shard1_replica_n2 url=https://127.0.0.1:63883/solr DONE. We have no versions. sync failed.
[junit4] 2> 893693 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 893693 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 893693 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 893699 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:63883/solr/addReplicaColl_shard1_replica_n2/ shard1
[junit4] 2> 893807 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893807 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893807 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893807 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893808 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893808 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893807 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893807 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 893853 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 893858 INFO (qtp1464899308-10403) [n:127.0.0.1:63883_solr c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2277
[junit4] 2> 893894 INFO (qtp1142627464-10420) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node3 x:addReplicaColl_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2345
[junit4] 2> 893905 INFO (qtp623535642-10413) [n:127.0.0.1:63884_solr c:addReplicaColl s:shard2 r:core_node8 x:addReplicaColl_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n6&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2317
[junit4] 2> 893911 INFO (qtp1142627464-10424) [n:127.0.0.1:63885_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 894022 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894022 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 894913 INFO (qtp1142627464-10424) [n:127.0.0.1:63885_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=4&name=addReplicaColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=3729
[junit4] 2> 894914 INFO (qtp1142627464-10425) [n:127.0.0.1:63885_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:63885_solr&action=ADDREPLICA&collection=addReplicaColl&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 894917 INFO (OverseerThreadFactory-3893-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:63885_solr for creating new replica
[junit4] 2> 894918 INFO (OverseerCollectionConfigSetProcessor-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 894921 INFO (OverseerStateUpdate-98763928973279242-127.0.0.1:63883_solr-n_0000000000) [n:127.0.0.1:63883_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"addReplicaColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"addReplicaColl_shard1_replica_n9",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63885/solr",
[junit4] 2> "node_name":"127.0.0.1:63885_solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 895025 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895025 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895026 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895026 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895026 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895026 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895026 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895025 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895130 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node10&collection.configName=conf&name=addReplicaColl_shard1_replica_n9&action=CREATE&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 895197 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 895202 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n9] Schema name=minimal
[junit4] 2> 895205 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 895205 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n9' using configuration from collection addReplicaColl, trusted=true
[junit4] 2> 895205 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard1.replica_n9' (registry 'solr.core.addReplicaColl.shard1.replica_n9') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@76988345
[junit4] 2> 895206 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 895206 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n9] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node1/addReplicaColl_shard1_replica_n9], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001/tempDir-001/node1/addReplicaColl_shard1_replica_n9/data/]
[junit4] 2> 895246 INFO (zkCallback-1902-thread-2-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895246 INFO (zkCallback-1902-thread-1-processing-n:127.0.0.1:63883_solr) [n:127.0.0.1:63883_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895246 INFO (zkCallback-1895-thread-1-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895246 INFO (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895246 INFO (zkCallback-1907-thread-1-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895247 INFO (zkCallback-1907-thread-2-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895247 INFO (zkCallback-1896-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895247 INFO (zkCallback-1896-thread-2-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
[junit4] 2> 895268 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 895268 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 895292 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 895293 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 895294 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.s.SolrIndexSearcher Opening [Searcher@4772b8cb[addReplicaColl_shard1_replica_n9] main]
[junit4] 2> 895296 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 895297 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 895297 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 895298 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580222868788084736
[junit4] 2> 895298 INFO (searcherExecutor-3922-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.SolrCore [addReplicaColl_shard1_replica_n9] Registered new searcher Searcher@4772b8cb[addReplicaColl_shard1_replica_n9] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 895301 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.ZkController Core needs to recover:addReplicaColl_shard1_replica_n9
[junit4] 2> 895302 INFO (updateExecutor-1889-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 895302 INFO (qtp1142627464-10421) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node10&collection.configName=conf&name=addReplicaColl_shard1_replica_n9&action=CREATE&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=172
[junit4] 2> 895303 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 895303 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 895303 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[addReplicaColl_shard1_replica_n9]
[junit4] 2> 895303 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 895303 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.RecoveryStrategy Publishing state of core [addReplicaColl_shard1_replica_n9] as recovering, leader is [https://127.0.0.1:63883/solr/addReplicaColl_shard1_replica_n2/] and I am [https://127.0.0.1:63885/solr/addReplicaColl_shard1_replica_n9/]
[junit4] 2> 895306 INFO (qtp1142627464-10425) [n:127.0.0.1:63885_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:63885_solr&action=ADDREPLICA&collection=addReplicaColl&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=392
[junit4] 2> 895309 INFO (recoveryExecutor-1890-thread-1-processing-n:127.0.0.1:63885_solr x:addReplicaColl_shard1_replica_n9 s:shard1 c:addReplicaColl r:core_node10) [n:127.0.0.1:63885_solr c:addReplicaColl s:shard1 r:core_node10 x:addReplicaColl_shard1_replica_n9] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:63883/solr]; [WaitForState: action=PREPRECOVERY&core=addReplicaColl_shard1_replica_n2&nodeName=127.0.0.1:63885_solr&coreNodeName=core_node10&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 895310
[...truncated too long message...]
osing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 979981 INFO (jetty-closer-1883-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7648def5: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3ad47d5f
[junit4] 2> 979982 INFO (jetty-closer-1883-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 979982 INFO (jetty-closer-1883-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@156599b6: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18911437
[junit4] 2> 979983 INFO (jetty-closer-1883-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 979983 INFO (jetty-closer-1883-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61dc3a7f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18911437
[junit4] 2> 979985 INFO (jetty-closer-1883-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 979986 INFO (jetty-closer-1883-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 979999 INFO (jetty-closer-1883-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 979999 INFO (jetty-closer-1883-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@200adfc2: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18911437
[junit4] 2> 980000 WARN (zkCallback-1895-thread-2-processing-n:127.0.0.1:63885_solr) [n:127.0.0.1:63885_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 980002 INFO (jetty-closer-1883-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e8667c6{/solr,null,UNAVAILABLE}
[junit4] 2> 980003 INFO (zkCallback-1938-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 980003 INFO (zkCallback-1938-thread-5-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63888_solr
[junit4] 2> 980004 INFO (jetty-closer-1883-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 980006 WARN (zkCallback-1938-thread-1-processing-n:127.0.0.1:63888_solr) [n:127.0.0.1:63888_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 981501 WARN (zkCallback-1907-thread-4-processing-n:127.0.0.1:63884_solr) [n:127.0.0.1:63884_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 981502 INFO (jetty-closer-1883-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7d911e4b{/solr,null,UNAVAILABLE}
[junit4] 2> 981506 INFO (jetty-closer-1883-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4922c5ad{/solr,null,UNAVAILABLE}
[junit4] 2> 981507 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 981508 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[6C149846216E6518]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:63881 63881
[junit4] 2> 981508 INFO (Thread-1900) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:63881 63881
[junit4] 2> 981630 WARN (Thread-1900) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/awhollynewcollection_0/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 20 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6C149846216E6518-001
[junit4] 2> Oct 03, 2017 8:07:30 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=1174, maxMBSortInHeap=7.667792162985795, sim=RandomSimilarity(queryNorm=false): {}, locale=he-IL, timezone=Europe/Istanbul
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=165820872,total=256974848
[junit4] 2> NOTE: All tests run in this JVM: [TestRandomCollapseQParserPlugin, TestPivotHelperCode, SuggesterFSTTest, SpatialHeatmapFacetsTest, TestNumericRangeQuery32, MBeansHandlerTest, OpenExchangeRatesOrgProviderTest, TestStressLucene, DistributedQueryComponentOptimizationTest, TestReloadDeadlock, StatsComponentTest, FileUtilsTest, TestExceedMaxTermLength, HttpPartitionTest, TestSchemaResource, TestBM25SimilarityFactory, TestUninvertingReader, TestTrie, TestCloudInspectUtil, SolrCmdDistributorTest, TestStressLiveNodes, UpdateParamsTest, TestQueryUtils, TestSolrFieldCacheBean, DistanceUnitsTest, ZkStateReaderTest, DistribCursorPagingTest, TestSolrCoreSnapshots, TestAuthorizationFramework, TestElisionMultitermQuery, TestLegacyTerms, HdfsDirectoryFactoryTest, ConjunctionSolrSpellCheckerTest, BlockDirectoryTest, FileBasedSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestComplexPhraseQParserPlugin, PluginInfoTest, TestSolr4Spatial2, DistributedMLTComponentTest, TestSSLRandomization, OverseerStatusTest, TestChildDocTransformer, TestSolrCLIRunExample, TestRandomFaceting, TestFastWriter, TestGraphTermsQParserPlugin, AnalyticsMergeStrategyTest, TestDFISimilarityFactory, TestSearchPerf, TestIndexSearcher, ReplicaListTransformerTest, TestStreamBody, JavabinLoaderTest, AnalysisErrorHandlingTest, TermVectorComponentDistributedTest, TestMultiWordSynonyms, TestSchemaVersionResource, TestDefaultStatsCache, CdcrBootstrapTest, OpenCloseCoreStressTest, BadIndexSchemaTest, DOMUtilTest, SmileWriterTest, DistributedFacetPivotWhiteBoxTest, ConvertedLegacyTest, RollingRestartTest, SignatureUpdateProcessorFactoryTest, DistribJoinFromCollectionTest, TestUnifiedSolrHighlighter, TestPerFieldSimilarityWithDefaultOverride, TestLeaderElectionWithEmptyReplica, AddSchemaFieldsUpdateProcessorFactoryTest, TestObjectReleaseTracker, TestRTGBase, TestMergePolicyConfig, CollectionReloadTest, TestRestoreCore, TestSolrCloudWithHadoopAuthPlugin, StressHdfsTest, TestLMJelinekMercerSimilarityFactory, ChaosMonkeySafeLeaderTest, PingRequestHandlerTest, V2ApiIntegrationTest, TestCollationFieldDocValues, TestFieldCacheSortRandom, DocumentBuilderTest, TestCrossCoreJoin, HttpSolrCallGetCoreTest, TestUniqueKeyFieldResource, TestGeoJSONResponseWriter, TestRuleBasedAuthorizationPlugin, TestPullReplica, LeaderFailoverAfterPartitionTest, TestSimpleQParserPlugin, TestCloudPivotFacet, CopyFieldTest, SolrCloudExampleTest, TestFileDictionaryLookup, TestSolrXml, TestScoreJoinQPNoScore, TestSolrCloudWithKerberosAlt, LeaderInitiatedRecoveryOnCommitTest, TestMacros, DistributedFacetPivotLargeTest, TestFieldCacheWithThreads, TestExclusionRuleCollectionAccess, CollectionsAPIDistributedZkTest]
[junit4] Completed [179/735 (1!)] on J1 in 91.85s, 19 tests, 1 error <<< FAILURES!
[...truncated 48316 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:669: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:682: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 86 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-9) - Build # 4203 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4203/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseSerialGC --illegal-access=deny
1 tests failed.
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at __randomizedtesting.SeedInfo.seed([6D84636BF133F509:71851EE684968B9A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 11918 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> 447502 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/init-core-data-001
[junit4] 2> 447502 WARN (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 447502 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 447503 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 447504 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001
[junit4] 2> 447504 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 447504 INFO (Thread-1057) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 447504 INFO (Thread-1057) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 447507 ERROR (Thread-1057) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 447614 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:54828
[junit4] 2> 447633 INFO (jetty-launcher-890-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 447633 INFO (jetty-launcher-890-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 447635 INFO (jetty-launcher-890-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70dd1aab{/solr,null,AVAILABLE}
[junit4] 2> 447635 INFO (jetty-launcher-890-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@152f31a6{/solr,null,AVAILABLE}
[junit4] 2> 447636 INFO (jetty-launcher-890-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5f00f4cd{SSL,[ssl, http/1.1]}{127.0.0.1:54830}
[junit4] 2> 447636 INFO (jetty-launcher-890-thread-2) [ ] o.e.j.s.Server Started @449736ms
[junit4] 2> 447636 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54830}
[junit4] 2> 447637 ERROR (jetty-launcher-890-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 447637 INFO (jetty-launcher-890-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@25800c74{SSL,[ssl, http/1.1]}{127.0.0.1:54831}
[junit4] 2> 447637 INFO (jetty-launcher-890-thread-1) [ ] o.e.j.s.Server Started @449736ms
[junit4] 2> 447637 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54831}
[junit4] 2> 447637 ERROR (jetty-launcher-890-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 447637 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T20:37:48.359140Z
[junit4] 2> 447638 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T20:37:48.359158Z
[junit4] 2> 447641 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 447641 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 447647 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54828/solr
[junit4] 2> 447648 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54828/solr
[junit4] 2> 447782 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 447783 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 447783 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54831_solr
[junit4] 2> 447784 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54830_solr
[junit4] 2> 447784 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98761222928924678-127.0.0.1:54831_solr-n_0000000000) starting
[junit4] 2> 447785 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 447786 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 447795 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54831_solr
[junit4] 2> 447798 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 447798 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 447821 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54830.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447829 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54831.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447848 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54831.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447848 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54831.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447850 INFO (jetty-launcher-890-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node1/.
[junit4] 2> 447851 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54830.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447851 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54830.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 447852 INFO (jetty-launcher-890-thread-2) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node2/.
[junit4] 2> 447884 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 447885 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54828/solr ready
[junit4] 2> 447890 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 447903 INFO (qtp1176915872-5019) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 447908 INFO (qtp1176915872-5019) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 447919 INFO (TEST-TestTlogReplica.testDeleteById-seed#[6D84636BF133F509]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteById
[junit4] 2> 447921 INFO (qtp1176915872-5021) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 447933 INFO (OverseerThreadFactory-2428-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_delete_by_id
[junit4] 2> 448049 INFO (OverseerStateUpdate-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54831/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 448053 INFO (OverseerStateUpdate-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54830/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 448272 INFO (qtp1176915872-5014) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 448272 INFO (qtp1176915872-5014) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 448279 INFO (qtp1713985369-5027) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 448279 INFO (qtp1713985369-5027) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 448389 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 448389 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 448389 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 448389 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449294 INFO (qtp1176915872-5014) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 449297 INFO (qtp1713985369-5027) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 449303 INFO (qtp1176915872-5014) [ ] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t2] Schema name=minimal
[junit4] 2> 449305 INFO (qtp1713985369-5027) [ ] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t1] Schema name=minimal
[junit4] 2> 449305 INFO (qtp1176915872-5014) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 449305 INFO (qtp1176915872-5014) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t2' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 449306 INFO (qtp1176915872-5014) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54830.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 449306 INFO (qtp1176915872-5014) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 449306 INFO (qtp1176915872-5014) [ ] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node2/tlog_replica_test_delete_by_id_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node2/./tlog_replica_test_delete_by_id_shard1_replica_t2/data/]
[junit4] 2> 449307 INFO (qtp1713985369-5027) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 449307 INFO (qtp1713985369-5027) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t1' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 449308 INFO (qtp1713985369-5027) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54831.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 449308 INFO (qtp1713985369-5027) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 449308 INFO (qtp1713985369-5027) [ ] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node1/tlog_replica_test_delete_by_id_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node1/./tlog_replica_test_delete_by_id_shard1_replica_t1/data/]
[junit4] 2> 449371 INFO (qtp1713985369-5027) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 449371 INFO (qtp1713985369-5027) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 449372 INFO (qtp1176915872-5014) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 449372 INFO (qtp1176915872-5014) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 449373 INFO (qtp1713985369-5027) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 449373 INFO (qtp1713985369-5027) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 449373 INFO (qtp1176915872-5014) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 449373 INFO (qtp1176915872-5014) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 449374 INFO (qtp1176915872-5014) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@10180b1d[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 449374 INFO (qtp1713985369-5027) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@16c9b59e[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 449376 INFO (qtp1176915872-5014) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 449376 INFO (qtp1713985369-5027) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 449376 INFO (qtp1176915872-5014) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 449376 INFO (qtp1713985369-5027) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 449377 INFO (qtp1176915872-5014) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 449377 INFO (qtp1713985369-5027) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 449377 INFO (qtp1176915872-5014) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580179568824680448
[junit4] 2> 449377 INFO (qtp1713985369-5027) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580179568824680448
[junit4] 2> 449377 INFO (searcherExecutor-2433-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@10180b1d[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 449378 INFO (searcherExecutor-2434-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@16c9b59e[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 449385 INFO (qtp1176915872-5014) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 449385 INFO (qtp1176915872-5014) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 449385 INFO (qtp1176915872-5014) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/
[junit4] 2> 449386 INFO (qtp1176915872-5014) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t2 url=https://127.0.0.1:54830/solr START replicas=[https://127.0.0.1:54831/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/] nUpdates=100
[junit4] 2> 449392 INFO (qtp1713985369-5030) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 449497 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449498 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449498 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449498 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449696 INFO (qtp1176915872-5014) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t2 url=https://127.0.0.1:54830/solr DONE. We have no versions. sync failed.
[junit4] 2> 449696 INFO (qtp1176915872-5014) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 449696 INFO (qtp1176915872-5014) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 449696 INFO (qtp1176915872-5014) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 449697 INFO (qtp1176915872-5014) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 449702 INFO (qtp1176915872-5014) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/ shard1
[junit4] 2> 449809 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449809 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449809 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449809 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449863 INFO (qtp1176915872-5014) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 449865 INFO (qtp1176915872-5014) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1593
[junit4] 2> 449980 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449980 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449980 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 449980 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 450390 INFO (qtp1713985369-5027) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 starting background replication from leader
[junit4] 2> 450390 INFO (qtp1713985369-5027) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 450391 INFO (qtp1713985369-5027) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 450391 INFO (qtp1713985369-5027) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 450391 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/
[junit4] 2> 450395 INFO (qtp1713985369-5027) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2116
[junit4] 2> 450395 INFO (qtp1176915872-5023) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 450396 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b6e2db1[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 450398 INFO (searcherExecutor-2434-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@5b6e2db1[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 450401 INFO (qtp1176915872-5021) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 450509 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 450509 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 450509 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 450509 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 451402 INFO (qtp1176915872-5021) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3481
[junit4] 2> 451413 INFO (qtp1713985369-5016) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1580179570952241152&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&wt=javabin&version=2}{deleteByQuery=*:* (-1580179570952241152)} 0 0
[junit4] 2> 451415 INFO (qtp1713985369-5024) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 451418 INFO (qtp1176915872-5019) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580179570964824064,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 451418 INFO (qtp1176915872-5019) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 451418 INFO (qtp1176915872-5019) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 451418 INFO (qtp1176915872-5019) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 451419 INFO (qtp1176915872-5022) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:6&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580179570952241152),commit=} 0 13
[junit4] 2> 451424 INFO (qtp1713985369-5026) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&wt=javabin&version=2}{add=[1 (1580179570969018368)]} 0 0
[junit4] 2> 451425 INFO (qtp1176915872-5018) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:6&wt=javabin&version=2}{add=[1 (1580179570969018368)]} 0 3
[junit4] 2> 451429 INFO (qtp1176915872-5021) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580179570976358400,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 451429 INFO (qtp1176915872-5021) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@12618935 commitCommandVersion:1580179570976358400
[junit4] 2> 451429 INFO (qtp1713985369-5028) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 451432 INFO (qtp1176915872-5021) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6bcd0719[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 451432 INFO (qtp1176915872-5021) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 451433 INFO (searcherExecutor-2433-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@6bcd0719[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 451433 INFO (qtp1176915872-5021) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4
[junit4] 2> 451435 INFO (qtp1176915872-5023) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:6&commit=true&wt=javabin&version=2}{commit=} 0 9
[junit4] 2> 451441 INFO (qtp1713985369-5027) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 451544 INFO (qtp1713985369-5016) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 451655 INFO (qtp1713985369-5024) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 451766 INFO (qtp1713985369-5026) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 451878 INFO (qtp1713985369-5026) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 451940 INFO (OverseerCollectionConfigSetProcessor-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 451989 INFO (qtp1713985369-5030) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452099 INFO (qtp1713985369-5029) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452209 INFO (qtp1713985369-5029) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452318 INFO (qtp1713985369-5016) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452425 INFO (qtp1713985369-5024) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452532 INFO (qtp1713985369-5028) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452640 INFO (qtp1713985369-5026) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452745 INFO (qtp1713985369-5030) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452850 INFO (qtp1713985369-5027) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 452961 INFO (qtp1713985369-5029) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 453065 INFO (qtp1713985369-5016) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 453166 INFO (qtp1713985369-5024) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 453269 INFO (qtp1713985369-5028) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 453375 INFO (qtp1713985369-5026) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 453404 INFO (qtp1176915872-5014) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 453404 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 453404 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1506976672150
[junit4] 2> 453404 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 453404 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 453404 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 453405 INFO (qtp1176915872-5017) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4] 2> 453405 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Number of files in latest index in master: 13
[junit4] 2> 453406 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@79c45d50 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@133dd41b)
[junit4] 2> 453407 INFO (qtp1176915872-5019) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453409 INFO (qtp1176915872-5022) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453411 INFO (qtp1176915872-5018) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tim&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453412 INFO (qtp1176915872-5021) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453413 INFO (qtp1176915872-5023) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453429 INFO (qtp1176915872-5014) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453431 INFO (qtp1176915872-5017) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tip&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453432 INFO (qtp1176915872-5019) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453434 INFO (qtp1176915872-5022) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453435 INFO (qtp1176915872-5018) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453436 INFO (qtp1176915872-5021) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453438 INFO (qtp1176915872-5023) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453439 INFO (qtp1176915872-5014) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 453440 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=2178) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@79c45d50 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@133dd41b)
[junit4] 2> 453441 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 453441 INFO (indexFetcher-2444-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4c5d8bbd[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 453443 INFO (searcherExecutor-2434-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@4c5d8bbd[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 453482 INFO (qtp1713985369-5030) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 453487 INFO (qtp1176915872-5017) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 453492 INFO (qtp1713985369-5029) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:54830/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/&wt=javabin&version=2}{delete=[1 (-1580179573136424960)]} 0 0
[junit4] 2> 453492 INFO (qtp1176915872-5021) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={wt=javabin&version=2}{delete=[1 (-1580179573136424960)]} 0 3
[junit4] 2> 453497 INFO (qtp1713985369-5026) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&id=1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 453497 INFO (TEST-TestTlogReplica.testDeleteById-seed#[6D84636BF133F509]) [ ] o.a.s.c.TestTlogReplica tearDown deleting collection
[junit4] 2> 453498 INFO (qtp1176915872-5014) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 453502 INFO (OverseerThreadFactory-2428-thread-2) [ ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 453508 INFO (qtp1176915872-5019) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=null
[junit4] 2> 453508 INFO (qtp1176915872-5019) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5e2c538a: rootName = solr_54830, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2 / com.codahale.metrics.MetricRegistry@28786d11
[junit4] 2> 453509 INFO (qtp1713985369-5027) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=null
[junit4] 2> 453509 INFO (qtp1713985369-5027) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a5b2b02: rootName = solr_54831, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1 / com.codahale.metrics.MetricRegistry@47f20da7
[junit4] 2> 453526 INFO (qtp1176915872-5019) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 453526 INFO (qtp1176915872-5019) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] CLOSING SolrCore org.apache.solr.core.SolrCore@671f88c7
[junit4] 2> 453526 INFO (qtp1176915872-5019) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=1730119879
[junit4] 2> 453526 INFO (qtp1176915872-5019) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=1730119879
[junit4] 2> 453527 INFO (qtp1713985369-5027) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 453527 INFO (qtp1713985369-5027) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] CLOSING SolrCore org.apache.solr.core.SolrCore@1f117234
[junit4] 2> 453527 INFO (qtp1713985369-5027) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=521237044
[junit4] 2> 453527 INFO (qtp1713985369-5027) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=521237044
[junit4] 2> 453531 INFO (qtp1713985369-5027) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 453532 WARN (zkCallback-902-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 453532 INFO (qtp1713985369-5027) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=23
[junit4] 2> 453532 INFO (qtp1176915872-5019) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=25
[junit4] 2> 453536 INFO (zkCallback-908-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 453648 INFO (zkCallback-908-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 454253 INFO (qtp1176915872-5014) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2} status=0 QTime=754
[junit4] 2> 454253 INFO (TEST-TestTlogReplica.testDeleteById-seed#[6D84636BF133F509]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteById
[junit4] 2> 454266 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBasicLeaderElection
[junit4] 2> 454267 INFO (qtp1176915872-5022) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_basic_leader_election&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 454269 INFO (OverseerThreadFactory-2428-thread-3) [ ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_basic_leader_election
[junit4] 2> 454270 INFO (OverseerCollectionConfigSetProcessor-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 454500 INFO (OverseerStateUpdate-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_basic_leader_election",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_basic_leader_election_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54831/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 454509 INFO (OverseerStateUpdate-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_basic_leader_election",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_basic_leader_election_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54830/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 454713 INFO (qtp1176915872-5017) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_basic_leader_election_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_basic_leader_election&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 454713 INFO (qtp1713985369-5029) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_basic_leader_election_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_basic_leader_election&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 454832 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 454832 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 454832 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 454832 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 455743 INFO (qtp1176915872-5017) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 455743 INFO (qtp1713985369-5029) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 455770 INFO (qtp1176915872-5017) [ ] o.a.s.s.IndexSchema [tlog_replica_test_basic_leader_election_shard1_replica_t2] Schema name=minimal
[junit4] 2> 455770 INFO (qtp1713985369-5029) [ ] o.a.s.s.IndexSchema [tlog_replica_test_basic_leader_election_shard1_replica_t1] Schema name=minimal
[junit4] 2> 455772 INFO (qtp1713985369-5029) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 455772 INFO (qtp1176915872-5017) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 455772 INFO (qtp1713985369-5029) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_basic_leader_election_shard1_replica_t1' using configuration from collection tlog_replica_test_basic_leader_election, trusted=true
[junit4] 2> 455772 INFO (qtp1176915872-5017) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_basic_leader_election_shard1_replica_t2' using configuration from collection tlog_replica_test_basic_leader_election, trusted=true
[junit4] 2> 455772 INFO (qtp1713985369-5029) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54831.solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 455772 INFO (qtp1176915872-5017) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54830.solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a920304
[junit4] 2> 455772 INFO (qtp1713985369-5029) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 455772 INFO (qtp1176915872-5017) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 455772 INFO (qtp1713985369-5029) [ ] o.a.s.c.SolrCore [[tlog_replica_test_basic_leader_election_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node1/tlog_replica_test_basic_leader_election_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node1/./tlog_replica_test_basic_leader_election_shard1_replica_t1/data/]
[junit4] 2> 455772 INFO (qtp1176915872-5017) [ ] o.a.s.c.SolrCore [[tlog_replica_test_basic_leader_election_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node2/tlog_replica_test_basic_leader_election_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001/tempDir-001/node2/./tlog_replica_test_basic_leader_election_shard1_replica_t2/data/]
[junit4] 2> 455825 INFO (qtp1176915872-5017) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 455826 INFO (qtp1176915872-5017) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 455826 INFO (qtp1713985369-5029) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 455826 INFO (qtp1713985369-5029) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 455827 INFO (qtp1176915872-5017) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 455827 INFO (qtp1176915872-5017) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 455827 INFO (qtp1713985369-5029) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 455827 INFO (qtp1713985369-5029) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 455828 INFO (qtp1176915872-5017) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7369e7c3[tlog_replica_test_basic_leader_election_shard1_replica_t2] main]
[junit4] 2> 455828 INFO (qtp1713985369-5029) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@407a8c7d[tlog_replica_test_basic_leader_election_shard1_replica_t1] main]
[junit4] 2> 455830 INFO (qtp1713985369-5029) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 455830 INFO (qtp1176915872-5017) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 455830 INFO (qtp1713985369-5029) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 455830 INFO (qtp1176915872-5017) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 455831 INFO (qtp1713985369-5029) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 455831 INFO (qtp1176915872-5017) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 455831 INFO (qtp1176915872-5017) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580179575592189952
[junit4] 2> 455831 INFO (qtp1713985369-5029) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580179575592189952
[junit4] 2> 455831 INFO (searcherExecutor-2446-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_basic_leader_election_shard1_replica_t1] Registered new searcher Searcher@407a8c7d[tlog_replica_test_basic_leader_election_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 455832 INFO (searcherExecutor-2447-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_basic_leader_election_shard1_replica_t2] Registered new searcher Searcher@7369e7c3[tlog_replica_test_basic_leader_election_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 455839 INFO (qtp1713985369-5029) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 455839 INFO (qtp1713985369-5029) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 455839 INFO (qtp1713985369-5029) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/
[junit4] 2> 455839 INFO (qtp1713985369-5029) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_basic_leader_election_shard1_replica_t1 url=https://127.0.0.1:54831/solr START replicas=[https://127.0.0.1:54830/solr/tlog_replica_test_basic_leader_election_shard1_replica_t2/] nUpdates=100
[junit4] 2> 455842 INFO (qtp1176915872-5018) [ ] o.a.s.c.S.Request [tlog_replica_test_basic_leader_election_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 455948 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 455948 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 455948 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 455948 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456149 INFO (qtp1713985369-5029) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_basic_leader_election_shard1_replica_t1 url=https://127.0.0.1:54831/solr DONE. We have no versions. sync failed.
[junit4] 2> 456150 INFO (qtp1713985369-5029) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 456150 INFO (qtp1713985369-5029) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 456150 INFO (qtp1713985369-5029) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 456151 INFO (qtp1713985369-5029) [ ] o.a.s.c.ZkController tlog_replica_test_basic_leader_election_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 456161 INFO (qtp1713985369-5029) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/ shard1
[junit4] 2> 456278 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456278 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456278 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456278 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456332 INFO (qtp1713985369-5029) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 456334 INFO (qtp1713985369-5029) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_basic_leader_election_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_basic_leader_election&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1620
[junit4] 2> 456439 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456439 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456439 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456439 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456843 INFO (qtp1176915872-5017) [ ] o.a.s.c.ZkController tlog_replica_test_basic_leader_election_shard1_replica_t2 starting background replication from leader
[junit4] 2> 456843 INFO (qtp1176915872-5017) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 456844 INFO (qtp1176915872-5017) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 456844 INFO (qtp1176915872-5017) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 456844 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/
[junit4] 2> 456845 INFO (qtp1176915872-5017) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_basic_leader_election_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_basic_leader_election&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2131
[junit4] 2> 456846 INFO (qtp1713985369-5028) [ ] o.a.s.c.S.Request [tlog_replica_test_basic_leader_election_shard1_replica_t1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 456846 INFO (indexFetcher-2457-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@141e9275[tlog_replica_test_basic_leader_election_shard1_replica_t2] main]
[junit4] 2> 456848 INFO (searcherExecutor-2447-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_basic_leader_election_shard1_replica_t2] Registered new searcher Searcher@141e9275[tlog_replica_test_basic_leader_election_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 456849 INFO (qtp1176915872-5022) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 456950 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456950 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456950 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 456950 INFO (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [2])
[junit4] 2> 457851 INFO (qtp1176915872-5022) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_basic_leader_election&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3584
[junit4] 2> 457861 INFO (qtp1176915872-5023) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1580179577715556352&distrib.from=https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/&wt=javabin&version=2}{deleteByQuery=*:* (-1580179577715556352)} 0 0
[junit4] 2> 457862 INFO (qtp1176915872-5021) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 457864 INFO (qtp1713985369-5026) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580179577723944960,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 457864 INFO (qtp1713985369-5026) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 457865 INFO (qtp1713985369-5026) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 457865 INFO (qtp1713985369-5026) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 457865 INFO (qtp1713985369-5024) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_basic_leader_election:6&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580179577715556352),commit=} 0 9
[junit4] 2> 457884 INFO (qtp1176915872-5021) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:54831/solr/tlog_replica_test_basic_leader_election_shard1_replica_t1/&wt=javabin&version=2}{add=[1 (1580179577727090688), 2 (1580179577743867904)]} 0 0
[junit4] 2> 457885 INFO (qtp1713985369-5027) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_basic_leader_election_shard1_replica_t1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1580179577727090688), 2 (1580179577743867904)]} 0 18
[junit4] 2> 457885 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.c.ChaosMonkey monkey: kill jetty! 54831
[junit4] 2> 457887 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@25800c74{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 457887 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1642260078
[junit4] 2> 457887 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 457887 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b7b9b8b: rootName = solr_54831, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@536deb19
[junit4] 2> 457893 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 457893 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@58eb593e: rootName = solr_54831, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@784e7b70
[junit4] 2> 457898 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 457898 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2fbb40de: rootName = solr_54831, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@296b7070
[junit4] 2> 457900 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 457901 INFO (coreCloseExecutor-2458-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_basic_leader_election_shard1_replica_t1] CLOSING SolrCore org.apache.solr.core.SolrCore@3be6c731
[junit4] 2> 457901 INFO (coreCloseExecutor-2458-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t1, tag=1004980017
[junit4] 2> 457901 INFO (coreCloseExecutor-2458-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79389196: rootName = solr_54831, domain = solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t1, service url = null, agent id = null] for registry solr.core.tlog_replica_test_basic_leader_election.shard1.replica_t1 / com.codahale.metrics.MetricRegistry@609fd9c2
[junit4] 2> 457908 INFO (coreCloseExecutor-2458-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_basic_leader_election.shard1.leader, tag=1004980017
[junit4] 2> 457920 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.c.Overseer Overseer (id=98761222928924678-127.0.0.1:54831_solr-n_0000000000) closing
[junit4] 2> 457920 INFO (OverseerStateUpdate-98761222928924678-127.0.0.1:54831_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:54831_solr
[junit4] 2> 457922 INFO (zkCallback-908-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 457922 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54830_solr
[junit4] 2> 457922 INFO (zkCallback-901-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 457924 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 457924 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98761222928924677-127.0.0.1:54830_solr-n_0000000001) starting
[junit4] 2> 457935 INFO (zkCallback-901-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 457935 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 457935 INFO (zkCallback-908-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 458040 INFO (zkCallback-901-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 458040 INFO (zkCallback-901-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 458040 INFO (zkCallback-908-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_basic_leader_election/state.json] for collection [tlog_replica_test_basic_leader_election] has occurred - updating... (live nodes size: [1])
[junit4] 2> 459422 WARN (zkCallback-902-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 459422 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@152f31a6{/solr,null,UNAVAILABLE}
[junit4] 2> 459423 INFO (TEST-TestTlogReplica.testBasicLeaderElection-seed#[6D84636BF133F509]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 54831
[junit4] 2> 460424 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:54830/solr/tlog_replica_test_basic_leader_election_shard1_replica_t2/
[junit4] 2> 460424 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 460424 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.SyncStrategy https://127.0.0.1:54830/solr/tlog_replica_test_basic_leader_election_shard1_replica_t2/ has no replicas
[junit4] 2> 460425 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.ZkController tlog_replica_test_basic_leader_election_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 460425 INFO (zkCallback-901-thread-1) [ ] o.a.s.c.ShardLea
[...truncated too long message...]
CoreContainer Shutting down CoreContainer instance=1593537186
[junit4] 2> 557100 INFO (jetty-closer-891-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@19123c6c{SSL,[ssl, http/1.1]}{127.0.0.1:54830}
[junit4] 2> 557100 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 557100 INFO (jetty-closer-891-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=826715367
[junit4] 2> 557100 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10b91df7: rootName = solr_54831, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@32573f56
[junit4] 2> 557100 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 557100 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ece8263: rootName = solr_54830, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@789938ab
[junit4] 2> 557105 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 557105 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@448b2f10: rootName = solr_54831, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@784e7b70
[junit4] 2> 557105 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 557105 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60e3dae0: rootName = solr_54830, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@784e7b70
[junit4] 2> 557116 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 557116 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5cb0836f: rootName = solr_54831, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@296b7070
[junit4] 2> 557117 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 557117 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@24e6219d: rootName = solr_54830, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@296b7070
[junit4] 2> 557118 INFO (jetty-closer-891-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 557119 INFO (jetty-closer-891-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 557121 INFO (jetty-closer-891-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98761222928924698-127.0.0.1:54830_solr-n_0000000007) closing
[junit4] 2> 557121 INFO (OverseerStateUpdate-98761222928924698-127.0.0.1:54830_solr-n_0000000007) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:54830_solr
[junit4] 2> 557123 INFO (jetty-closer-891-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@56a53695{/solr,null,UNAVAILABLE}
[junit4] 2> 557124 INFO (zkCallback-948-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 557125 WARN (zkCallback-948-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 557126 INFO (jetty-closer-891-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@39f01b58{/solr,null,UNAVAILABLE}
[junit4] 2> 557130 ERROR (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 557130 INFO (SUITE-TestTlogReplica-seed#[6D84636BF133F509]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54828 54828
[junit4] 2> 557172 INFO (Thread-1057) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54828 54828
[junit4] 2> 557906 WARN (Thread-1057) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 33 /solr/configs/conf
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 28 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 27 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 5 /solr/overseer_elect/election/98761222928924683-127.0.0.1:54831_solr-n_0000000002
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98761222928924683-core_node3-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/98761222928924692-core_node9-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/98761222928924692-core_node5-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98761222928924692-core_node13-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98761222928924692-core_node13-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_6D84636BF133F509-001
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=rof, timezone=America/Pangnirtung
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=139263744,total=448991232
[junit4] 2> NOTE: All tests run in this JVM: [InfixSuggestersTest, TestPayloadCheckQParserPlugin, MoreLikeThisHandlerTest, TestQueryWrapperFilter, EchoParamsTest, TestSystemCollAutoCreate, DocExpirationUpdateProcessorFactoryTest, TestApiFramework, TestBinaryResponseWriter, ZkStateWriterTest, TermVectorComponentDistributedTest, TestValueSourceCache, SampleTest, UpdateParamsTest, QueryResultKeyTest, ExternalFileFieldSortTest, SpellingQueryConverterTest, AddBlockUpdateTest, GraphQueryTest, TestPushWriter, TestDistributedMissingSort, SignatureUpdateProcessorFactoryTest, DocValuesMultiTest, SchemaVersionSpecificBehaviorTest, SubstringBytesRefFilterTest, DistributedDebugComponentTest, TestEmbeddedSolrServerConstructors, FieldMutatingUpdateProcessorTest, DistributedQueryElevationComponentTest, DocValuesMissingTest, PreAnalyzedFieldTest, TestDocBasedVersionConstraints, SynonymTokenizerTest, TestRecovery, TestNamedUpdateProcessors, MBeansHandlerTest, BasicAuthIntegrationTest, BooleanFieldTest, MoveReplicaHDFSTest, SpellCheckCollatorTest, TestRTGBase, TestConfigsApi, TestSolrCloudWithDelegationTokens, BadIndexSchemaTest, TestSlowCompositeReaderWrapper, SimpleCollectionCreateDeleteTest, TestBlendedInfixSuggestions, QueryEqualityTest, TestCloudInspectUtil, LeaderFailoverAfterPartitionTest, TestCloudRecovery, TestSerializedLuceneMatchVersion, TestZkChroot, TestFieldTypeCollectionResource, TestCollectionsAPIViaSolrCloudCluster, BasicFunctionalityTest, TestConfigSetProperties, SolrGraphiteReporterTest, ClassificationUpdateProcessorTest, TestNoOpRegenerator, TestRemoteStreaming, TestRebalanceLeaders, CollectionTooManyReplicasTest, TestCollationField, TestFieldCache, TestDistributedStatsComponentCardinality, DirectSolrSpellCheckerTest, TestManagedStopFilterFactory, RollingRestartTest, TestTlogReplica]
[junit4] Completed [163/734 (1!)] on J1 in 110.42s, 13 tests, 1 failure <<< FAILURES!
[...truncated 41639 lines...]
Re: [JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build #
4202 - Failure!
Posted by Michael McCandless <lu...@mikemccandless.com>.
I pushed a fix for this.
Mike McCandless
http://blog.mikemccandless.com
On Mon, Oct 2, 2017 at 7:02 AM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4202/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
>
> All tests passed
>
> Build Log:
> [...truncated 51045 lines...]
> -documentation-lint:
> [echo] checking for broken html...
> [jtidy] Checking for broken html (such as invalid tags)...
> [delete] Deleting directory /Users/jenkins/workspace/
> Lucene-Solr-master-MacOSX/lucene/build/jtidy_tmp
> [echo] Checking for broken links...
> [exec]
> [exec] Crawl/parse...
> [exec]
> [exec] Verify...
> [exec]
> [exec] file:///build/docs/sandbox/org/apache/lucene/document/
> FloatPointNearestNeighbor.html
> [exec] BROKEN LINK: file:///build/docs/core/org/
> apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
> [exec] BROKEN LINK: file:///build/docs/core/org/
> apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
> [exec]
> [exec] Broken javadocs links were found! Common root causes:
> [exec] * A typo of some sort for manually created links.
> [exec] * Public methods referencing non-public classes in their
> signature.
>
> BUILD FAILED
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:826: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build.xml:142:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build.xml:155:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2570:
> exec returned: 1
>
> Total time: 87 minutes 9 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> [WARNINGS] Skipping publisher since build result is FAILURE
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4202
- Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4202/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 51045 lines...]
-documentation-lint:
[echo] checking for broken html...
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///build/docs/sandbox/org/apache/lucene/document/FloatPointNearestNeighbor.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build.xml:142: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build.xml:155: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 87 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any