You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/11/20 01:42:39 UTC
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 942 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/942/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED: org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
Error Message:
Expected new active leader null Live Nodes: [127.0.0.1:49688_solr, 127.0.0.1:49689_solr, 127.0.0.1:49690_solr] Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/14)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "core":"raceDeleteReplica_true_shard1_replica_n2", "base_url":"http://127.0.0.1:49691/solr", "node_name":"127.0.0.1:49691_solr", "state":"down", "type":"NRT", "leader":"true"}, "core_node6":{ "core":"raceDeleteReplica_true_shard1_replica_n5", "base_url":"http://127.0.0.1:49691/solr", "node_name":"127.0.0.1:49691_solr", "state":"down", "type":"NRT"}, "core_node3":{ "core":"raceDeleteReplica_true_shard1_replica_n1", "base_url":"http://127.0.0.1:49689/solr", "node_name":"127.0.0.1:49689_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Expected new active leader
null
Live Nodes: [127.0.0.1:49688_solr, 127.0.0.1:49689_solr, 127.0.0.1:49690_solr]
Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/14)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"raceDeleteReplica_true_shard1_replica_n2",
"base_url":"http://127.0.0.1:49691/solr",
"node_name":"127.0.0.1:49691_solr",
"state":"down",
"type":"NRT",
"leader":"true"},
"core_node6":{
"core":"raceDeleteReplica_true_shard1_replica_n5",
"base_url":"http://127.0.0.1:49691/solr",
"node_name":"127.0.0.1:49691_solr",
"state":"down",
"type":"NRT"},
"core_node3":{
"core":"raceDeleteReplica_true_shard1_replica_n1",
"base_url":"http://127.0.0.1:49689/solr",
"node_name":"127.0.0.1:49689_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([FD8F42273B98DC71:979923F7536A96BB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:280)
at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:334)
at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:229)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards
Error Message:
Error from server at http://127.0.0.1:49689/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49689/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
at __randomizedtesting.SeedInfo.seed([FD8F42273B98DC71:C11E057374D98124]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards(DeleteReplicaTest.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
Error Message:
Expected new active leader null Live Nodes: [127.0.0.1:64952_solr, 127.0.0.1:64953_solr, 127.0.0.1:64954_solr] Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/13)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"raceDeleteReplica_true_shard1_replica_n1", "base_url":"http://127.0.0.1:64955/solr", "node_name":"127.0.0.1:64955_solr", "state":"down", "type":"NRT", "leader":"true"}, "core_node6":{ "core":"raceDeleteReplica_true_shard1_replica_n5", "base_url":"http://127.0.0.1:64955/solr", "node_name":"127.0.0.1:64955_solr", "state":"down", "type":"NRT"}, "core_node4":{ "core":"raceDeleteReplica_true_shard1_replica_n2", "base_url":"http://127.0.0.1:64954/solr", "node_name":"127.0.0.1:64954_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Expected new active leader
null
Live Nodes: [127.0.0.1:64952_solr, 127.0.0.1:64953_solr, 127.0.0.1:64954_solr]
Last available state: DocCollection(raceDeleteReplica_true//collections/raceDeleteReplica_true/state.json/13)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"raceDeleteReplica_true_shard1_replica_n1",
"base_url":"http://127.0.0.1:64955/solr",
"node_name":"127.0.0.1:64955_solr",
"state":"down",
"type":"NRT",
"leader":"true"},
"core_node6":{
"core":"raceDeleteReplica_true_shard1_replica_n5",
"base_url":"http://127.0.0.1:64955/solr",
"node_name":"127.0.0.1:64955_solr",
"state":"down",
"type":"NRT"},
"core_node4":{
"core":"raceDeleteReplica_true_shard1_replica_n2",
"base_url":"http://127.0.0.1:64954/solr",
"node_name":"127.0.0.1:64954_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([FD8F42273B98DC71:979923F7536A96BB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:280)
at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:334)
at org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:229)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards
Error Message:
Error from server at http://127.0.0.1:64953/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:64953/solr: Cannot create collection deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
at __randomizedtesting.SeedInfo.seed([FD8F42273B98DC71:C11E057374D98124]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards(DeleteReplicaTest.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12908 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/init-core-data-001
[junit4] 2> 436110 WARN (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=889 numCloses=889
[junit4] 2> 436111 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 436115 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 436115 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 436115 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001
[junit4] 2> 436116 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 436116 INFO (Thread-687) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 436116 INFO (Thread-687) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 436119 ERROR (Thread-687) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 436216 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:64950
[junit4] 2> 436229 INFO (zkConnectionManagerCallback-3263-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436235 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 436235 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 436235 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 436235 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
[junit4] 2> 436236 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 436236 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 436236 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 436239 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@644266fb{/solr,null,AVAILABLE}
[junit4] 2> 436240 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 436240 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 436240 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 436240 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9d2d823{/solr,null,AVAILABLE}
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 436241 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 436242 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6eb48f08{/solr,null,AVAILABLE}
[junit4] 2> 436244 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24893fc7{/solr,null,AVAILABLE}
[junit4] 2> 436245 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@19db4945{HTTP/1.1,[http/1.1]}{127.0.0.1:64952}
[junit4] 2> 436245 INFO (jetty-launcher-3260-thread-1) [ ] o.e.j.s.Server Started @436320ms
[junit4] 2> 436245 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64952}
[junit4] 2> 436245 ERROR (jetty-launcher-3260-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 436245 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 436245 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@52e131fc{HTTP/1.1,[http/1.1]}{127.0.0.1:64954}
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.e.j.s.Server Started @436321ms
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64954}
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 436246 ERROR (jetty-launcher-3260-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T00:05:41.955Z
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@53d9674d{HTTP/1.1,[http/1.1]}{127.0.0.1:64953}
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-3) [ ] o.e.j.s.Server Started @436322ms
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64953}
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 436246 ERROR (jetty-launcher-3260-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T00:05:41.955Z
[junit4] 2> 436246 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7e695137{HTTP/1.1,[http/1.1]}{127.0.0.1:64955}
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.e.j.s.Server Started @436322ms
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64955}
[junit4] 2> 436247 ERROR (jetty-launcher-3260-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T00:05:41.956Z
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 436247 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T00:05:41.956Z
[junit4] 2> 436251 INFO (zkConnectionManagerCallback-3269-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436251 INFO (zkConnectionManagerCallback-3271-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436251 INFO (zkConnectionManagerCallback-3265-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436252 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 436252 INFO (zkConnectionManagerCallback-3267-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436252 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 436253 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 436253 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 436368 INFO (jetty-launcher-3260-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64950/solr
[junit4] 2> 436370 INFO (zkConnectionManagerCallback-3275-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436372 INFO (zkConnectionManagerCallback-3277-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436514 INFO (jetty-launcher-3260-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64950/solr
[junit4] 2> 436515 INFO (zkConnectionManagerCallback-3283-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436518 INFO (zkConnectionManagerCallback-3285-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436535 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64953_solr
[junit4] 2> 436535 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64954_solr
[junit4] 2> 436536 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.Overseer Overseer (id=72140768992428040-127.0.0.1:64953_solr-n_0000000000) starting
[junit4] 2> 436538 INFO (zkCallback-3276-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 436546 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 436595 INFO (zkConnectionManagerCallback-3292-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436603 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 436603 INFO (zkConnectionManagerCallback-3297-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436605 INFO (jetty-launcher-3260-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64950/solr
[junit4] 2> 436606 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 436607 INFO (zkConnectionManagerCallback-3301-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436609 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64950/solr ready
[junit4] 2> 436610 INFO (OverseerStateUpdate-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:64953_solr
[junit4] 2> 436616 INFO (zkConnectionManagerCallback-3303-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436623 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64950/solr ready
[junit4] 2> 436623 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 436623 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64953_solr
[junit4] 2> 436626 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 436627 INFO (zkCallback-3291-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 436627 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 436634 INFO (zkCallback-3296-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 436634 INFO (zkCallback-3276-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 436647 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 436648 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 436654 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 436654 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64952_solr
[junit4] 2> 436656 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 436656 INFO (zkCallback-3291-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 436656 INFO (zkCallback-3296-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 436657 INFO (zkCallback-3302-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 436664 INFO (zkCallback-3276-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 436701 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64954.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436707 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64953.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436715 INFO (zkConnectionManagerCallback-3312-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436718 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64953.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436718 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64953.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436719 INFO (jetty-launcher-3260-thread-3) [n:127.0.0.1:64953_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node3/.
[junit4] 2> 436723 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64954.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436723 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64954.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436724 INFO (jetty-launcher-3260-thread-2) [n:127.0.0.1:64954_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node2/.
[junit4] 2> 436727 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 436729 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64950/solr ready
[junit4] 2> 436730 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 436757 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64952.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436764 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64952.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436765 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64952.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436770 INFO (jetty-launcher-3260-thread-1) [n:127.0.0.1:64952_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node1/.
[junit4] 2> 436789 INFO (jetty-launcher-3260-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64950/solr
[junit4] 2> 436791 INFO (zkConnectionManagerCallback-3317-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436794 INFO (zkConnectionManagerCallback-3319-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436811 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 436818 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 436818 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64955_solr
[junit4] 2> 436820 INFO (zkCallback-3296-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436820 INFO (zkCallback-3302-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436821 INFO (zkCallback-3318-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436821 INFO (zkCallback-3291-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436821 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436822 INFO (zkCallback-3311-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436822 INFO (zkCallback-3276-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 436860 INFO (zkConnectionManagerCallback-3326-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436863 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 436864 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64950/solr ready
[junit4] 2> 436865 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 436882 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64955.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436893 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64955.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436893 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64955.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 436894 INFO (jetty-launcher-3260-thread-4) [n:127.0.0.1:64955_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node4/.
[junit4] 2> 436938 INFO (zkConnectionManagerCallback-3329-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436943 INFO (zkConnectionManagerCallback-3334-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 436946 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 436947 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64950/solr ready
[junit4] IGNOR/A 0.00s J0 | DeleteReplicaTest.deleteReplicaFromClusterState
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
[junit4] 2> 436997 INFO (TEST-DeleteReplicaTest.deleteReplicaByCount-seed#[FD8F42273B98DC71]) [ ] o.a.s.SolrTestCaseJ4 ###Starting deleteReplicaByCount
[junit4] 2> 436999 INFO (qtp804626088-6080) [n:127.0.0.1:64954_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=2&collection.configName=conf&name=deleteByCount&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 437002 INFO (OverseerThreadFactory-1867-thread-1-processing-n:127.0.0.1:64953_solr) [n:127.0.0.1:64953_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection deleteByCount
[junit4] 2> 437125 INFO (qtp804626088-6060) [n:127.0.0.1:64954_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 437127 INFO (qtp1610859872-6085) [n:127.0.0.1:64955_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 437129 INFO (qtp1546322315-6062) [n:127.0.0.1:64952_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 437131 INFO (qtp591719805-6076) [n:127.0.0.1:64953_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 437140 INFO (OverseerStateUpdate-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deleteByCount",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteByCount_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64953/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 437146 INFO (OverseerStateUpdate-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deleteByCount",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteByCount_shard1_replica_p2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64952/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 437153 INFO (OverseerStateUpdate-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deleteByCount",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteByCount_shard1_replica_p4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64955/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 437368 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p2&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 437368 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr x:deleteByCount_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 437368 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p4&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 438423 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 438423 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 438423 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 438445 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_p2] Schema name=minimal
[junit4] 2> 438445 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_n1] Schema name=minimal
[junit4] 2> 438445 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.IndexSchema [deleteByCount_shard1_replica_p4] Schema name=minimal
[junit4] 2> 438453 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 438454 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_n1' using configuration from collection deleteByCount, trusted=true
[junit4] 2> 438454 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 438454 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_p4' using configuration from collection deleteByCount, trusted=true
[junit4] 2> 438454 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64955.solr.core.deleteByCount.shard1.replica_p4' (registry 'solr.core.deleteByCount.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 438454 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64953.solr.core.deleteByCount.shard1.replica_n1' (registry 'solr.core.deleteByCount.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 438454 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_p4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node4/deleteByCount_shard1_replica_p4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node4/./deleteByCount_shard1_replica_p4/data/]
[junit4] 2> 438454 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node3/deleteByCount_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node3/./deleteByCount_shard1_replica_n1/data/]
[junit4] 2> 438462 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 438464 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.CoreContainer Creating SolrCore 'deleteByCount_shard1_replica_p2' using configuration from collection deleteByCount, trusted=true
[junit4] 2> 438464 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64952.solr.core.deleteByCount.shard1.replica_p2' (registry 'solr.core.deleteByCount.shard1.replica_p2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bf68e76
[junit4] 2> 438464 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [[deleteByCount_shard1_replica_p2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node1/deleteByCount_shard1_replica_p2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001/tempDir-001/node1/./deleteByCount_shard1_replica_p2/data/]
[junit4] 2> 438582 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 438582 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 438585 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 438585 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 438600 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 438600 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 438600 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 438600 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 438601 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@5269ab81[deleteByCount_shard1_replica_p4] main]
[junit4] 2> 438602 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@66cd6755[deleteByCount_shard1_replica_n1] main]
[junit4] 2> 438602 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3915bb93[deleteByCount_shard1_replica_p2] main]
[junit4] 2> 438603 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 438603 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 438604 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 438604 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 438604 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 438604 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 438604 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 438605 INFO (searcherExecutor-1887-thread-1-processing-n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4 c:deleteByCount s:shard1 r:core_node6) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] Registered new searcher Searcher@5269ab81[deleteByCount_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 438605 INFO (searcherExecutor-1888-thread-1-processing-n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2 c:deleteByCount s:shard1 r:core_node5) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2] Registered new searcher Searcher@3915bb93[deleteByCount_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 438606 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 438608 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 438609 INFO (searcherExecutor-1886-thread-1-processing-n:127.0.0.1:64953_solr x:deleteByCount_shard1_replica_n1 c:deleteByCount s:shard1 r:core_node3) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SolrCore [deleteByCount_shard1_replica_n1] Registered new searcher Searcher@66cd6755[deleteByCount_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 438609 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617609196115591168
[junit4] 2> 438611 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.ZkController deleteByCount_shard1_replica_p4 starting background replication from leader
[junit4] 2> 438611 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.ZkController deleteByCount_shard1_replica_p2 starting background replication from leader
[junit4] 2> 438616 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteByCount/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 438621 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
[junit4] 2> 438621 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
[junit4] 2> 438626 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 438626 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 438627 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 438627 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 438628 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 438628 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 438628 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64953/solr/deleteByCount_shard1_replica_n1/
[junit4] 2> 438629 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 438629 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:64953/solr/deleteByCount_shard1_replica_n1/ has no replicas
[junit4] 2> 438629 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 438792 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64953/solr/deleteByCount_shard1_replica_n1/ shard1
[junit4] 2> 438905 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 438909 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1541
[junit4] 2> 438951 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 438951 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 439013 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 439628 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
[junit4] 2> 439628 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
[junit4] 2> 439630 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:64953/solr/deleteByCount_shard1_replica_n1/
[junit4] 2> 439630 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:64953/solr/deleteByCount_shard1_replica_n1/
[junit4] 2> 439631 INFO (qtp591719805-6075) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.S.Request [deleteByCount_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 439632 INFO (qtp591719805-6058) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.S.Request [deleteByCount_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 439632 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6c6c572f commitCommandVersion:0
[junit4] 2> 439632 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@75a92cd8 commitCommandVersion:0
[junit4] 2> 439638 INFO (qtp1546322315-6056) [n:127.0.0.1:64952_solr c:deleteByCount s:shard1 r:core_node5 x:deleteByCount_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p2&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=2269
[junit4] 2> 439638 INFO (qtp1610859872-6067) [n:127.0.0.1:64955_solr c:deleteByCount s:shard1 r:core_node6 x:deleteByCount_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteByCount_shard1_replica_p4&action=CREATE&numShards=1&collection=deleteByCount&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=2269
[junit4] 2> 439641 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@180dfc70[deleteByCount_shard1_replica_p2] main]
[junit4] 2> 439641 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d15801[deleteByCount_shard1_replica_p4] main]
[junit4] 2> 439642 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 439642 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 439643 INFO (searcherExecutor-1887-thread-1) [ ] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] Registered new searcher Searcher@1d15801[deleteByCount_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 439643 INFO (searcherExecutor-1888-thread-1) [ ] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2] Registered new searcher Searcher@180dfc70[deleteByCount_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 439644 INFO (qtp804626088-6080) [n:127.0.0.1:64954_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 439741 INFO (zkCallback-3302-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 439741 INFO (zkCallback-3284-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 439741 INFO (zkCallback-3318-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 440637 INFO (qtp591719805-6075) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.S.Request [deleteByCount_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 440637 INFO (qtp591719805-6078) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.c.S.Request [deleteByCount_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 2
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 2
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1542672345341
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1542672345341
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 440637 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6c6c572f commitCommandVersion:0
[junit4] 2> 440637 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@75a92cd8 commitCommandVersion:0
[junit4] 2> 440638 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@8f2ee90[deleteByCount_shard1_replica_p4] main]
[junit4] 2> 440638 INFO (indexFetcher-1901-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 440638 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b890cac[deleteByCount_shard1_replica_p2] main]
[junit4] 2> 440638 INFO (indexFetcher-1902-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 440639 INFO (searcherExecutor-1887-thread-1) [ ] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] Registered new searcher Searcher@8f2ee90[deleteByCount_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 440639 INFO (searcherExecutor-1888-thread-1) [ ] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2] Registered new searcher Searcher@2b890cac[deleteByCount_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 440649 INFO (qtp804626088-6080) [n:127.0.0.1:64954_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=2&collection.configName=conf&name=deleteByCount&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3650
[junit4] 2> 440653 INFO (qtp804626088-6074) [n:127.0.0.1:64954_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params count=2&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 440660 INFO (OverseerCollectionConfigSetProcessor-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 440663 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p4, tag=null
[junit4] 2> 440669 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30dc6e2f: rootName = solr_64955, domain = solr.core.deleteByCount.shard1.replica_p4, service url = null, agent id = null] for registry solr.core.deleteByCount.shard1.replica_p4 / com.codahale.metrics.MetricRegistry@311ce6b0
[junit4] 2> 440686 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.c.ZkController deleteByCount_shard1_replica_p4 stopping background replication from leader
[junit4] 2> 440687 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p4] CLOSING SolrCore org.apache.solr.core.SolrCore@522cf1ec
[junit4] 2> 440687 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p4, tag=522cf1ec
[junit4] 2> 440687 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=522cf1ec
[junit4] 2> 440692 INFO (qtp1610859872-6081) [n:127.0.0.1:64955_solr x:deleteByCount_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=deleteByCount_shard1_replica_p4&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=29
[junit4] 2> 440800 INFO (zkCallback-3318-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 440800 INFO (zkCallback-3284-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 440800 INFO (zkCallback-3302-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 440905 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p2, tag=null
[junit4] 2> 440905 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1db5b1fe: rootName = solr_64952, domain = solr.core.deleteByCount.shard1.replica_p2, service url = null, agent id = null] for registry solr.core.deleteByCount.shard1.replica_p2 / com.codahale.metrics.MetricRegistry@6d536270
[junit4] 2> 440916 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.c.ZkController deleteByCount_shard1_replica_p2 stopping background replication from leader
[junit4] 2> 440917 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.c.SolrCore [deleteByCount_shard1_replica_p2] CLOSING SolrCore org.apache.solr.core.SolrCore@512d228f
[junit4] 2> 440917 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.deleteByCount.shard1.replica_p2, tag=512d228f
[junit4] 2> 440917 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=512d228f
[junit4] 2> 440919 INFO (qtp1546322315-6061) [n:127.0.0.1:64952_solr x:deleteByCount_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=deleteByCount_shard1_replica_p2&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=15
[junit4] 2> 441025 INFO (zkCallback-3284-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441025 INFO (zkCallback-3302-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteByCount/state.json] for collection [deleteByCount] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441136 INFO (qtp804626088-6074) [n:127.0.0.1:64954_solr c:deleteByCount ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={count=2&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2} status=0 QTime=482
[junit4] 2> 441140 INFO (qtp804626088-6083) [n:127.0.0.1:64954_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletereplica with params count=1&action=DELETEREPLICA&collection=deleteByCount&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 441143 INFO (OverseerCollectionConfigSetProcessor-72140768992428040-127.0.0.1:64953_solr-n_0000000000) [n:127.0.0.1:64953_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 441144 ERROR (OverseerThreadFactory-1867-thread-3-processing-n:127.0.0.1:64953_solr) [n:127.0.0.1:64953_solr c:deleteByCount s:shard1 ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: deleteByCount operation: deletereplica failed:org.apache.solr.common.SolrException: There is only one replica available in shard/collection: shard1/deleteByCount. Cannot delete that.
[junit4] 2> at org.apache.solr.cloud.api.collections.DeleteReplicaCmd.validateReplicaAvailability(DeleteReplicaCmd.java:191)
[junit4] 2> at org.apache.solr.cloud.api.collections.DeleteReplicaCmd.pickReplicasTobeDeleted(DeleteReplicaCmd.java:158)
[junit4] 2> at org.apache.solr.cloud.api.collections.DeleteRep
[...truncated too long message...]
solr.core.deleteReplicaOnIndexing.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.deleteReplicaOnIndexing.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1ffb1e29
[junit4] 2> 269177 INFO (coreCloseExecutor-451-thread-1) [n:127.0.0.1:49688_solr c:deleteByCount s:shard1 r:core_node3 x:deleteByCount_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=693bf79d
[junit4] 2> 269177 INFO (coreCloseExecutor-451-thread-2) [n:127.0.0.1:49688_solr c:delLiveColl s:shard2 r:core_node7 x:delLiveColl_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.delLiveColl.shard2.replica_n4, tag=3761e2e1
[junit4] 2> 269178 INFO (coreCloseExecutor-451-thread-2) [n:127.0.0.1:49688_solr c:delLiveColl s:shard2 r:core_node7 x:delLiveColl_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@799a9e6b: rootName = solr_49688, domain = solr.core.delLiveColl.shard2.replica_n4, service url = null, agent id = null] for registry solr.core.delLiveColl.shard2.replica_n4 / com.codahale.metrics.MetricRegistry@750ee72a
[junit4] 2> 269298 INFO (coreCloseExecutor-449-thread-2) [n:127.0.0.1:49690_solr c:delLiveColl s:shard2 r:core_node8 x:delLiveColl_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delLiveColl.shard2.leader, tag=29863900
[junit4] 2> 269308 INFO (coreCloseExecutor-450-thread-2) [n:127.0.0.1:49689_solr c:deleteReplicaOnIndexing s:shard1 r:core_node3 x:deleteReplicaOnIndexing_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.deleteReplicaOnIndexing.shard1.leader, tag=36aa1117
[junit4] 2> 269309 INFO (jetty-closer-145-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5379de0{/solr,null,UNAVAILABLE}
[junit4] 2> 269309 INFO (jetty-closer-145-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 269315 INFO (coreCloseExecutor-451-thread-2) [n:127.0.0.1:49688_solr c:delLiveColl s:shard2 r:core_node7 x:delLiveColl_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delLiveColl.shard2.leader, tag=3761e2e1
[junit4] 2> 269323 INFO (jetty-closer-145-thread-3) [ ] o.a.s.c.Overseer Overseer (id=72141119156781066-127.0.0.1:49688_solr-n_0000000000) closing
[junit4] 2> 269323 INFO (OverseerStateUpdate-72141119156781066-127.0.0.1:49688_solr-n_0000000000) [n:127.0.0.1:49688_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49688_solr
[junit4] 2> 269324 WARN (OverseerAutoScalingTriggerThread-72141119156781066-127.0.0.1:49688_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 269328 INFO (jetty-closer-145-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@333dcce8{/solr,null,UNAVAILABLE}
[junit4] 2> 269328 INFO (jetty-closer-145-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 269331 INFO (jetty-closer-145-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7e91a76d{/solr,null,UNAVAILABLE}
[junit4] 2> 269331 INFO (jetty-closer-145-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 269333 ERROR (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 269333 INFO (SUITE-DeleteReplicaTest-seed#[FD8F42273B98DC71]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49686 49686
[junit4] 2> 270451 INFO (Thread-373) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49686 49686
[junit4] 2> 270671 WARN (Thread-373) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 17 /solr/collections/deleteFromClusterState_true/terms/shard1
[junit4] 2> 17 /solr/collections/deleteFromClusterState_false/terms/shard1
[junit4] 2> 15 /solr/configs/conf
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 11 /solr/collections/deleteReplicaOnIndexing/terms/shard1
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 8 /solr/collections/raceDeleteReplica_true/terms/shard1
[junit4] 2> 7 /solr/collections/deletereplica_test/terms/shard1
[junit4] 2> 6 /solr/collections/deleteByCount/terms/shard1
[junit4] 2> 5 /solr/collections/delLiveColl/terms/shard2
[junit4] 2> 5 /solr/security.json
[junit4] 2> 4 /solr/collections/delLiveColl/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/raceDeleteReplica_true/state.json
[junit4] 2> 5 /solr/collections/delLiveColl/state.json
[junit4] 2> 5 /solr/collections/deleteReplicaOnIndexing/state.json
[junit4] 2> 4 /solr/collections/deleteByCount/state.json
[junit4] 2> 4 /solr/collections/deleteFromClusterState_true/state.json
[junit4] 2> 4 /solr/collections/deleteFromClusterState_false/state.json
[junit4] 2> 3 /solr/overseer_elect/election/72141119156781066-127.0.0.1:49688_solr-n_0000000000
[junit4] 2> 2 /solr/collections/deletereplica_test/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72141119156781063-127.0.0.1:49691_solr-n_0000000001
[junit4] 2> 2 /solr/collections/deleteFromClusterState_true/leader_elect/shard1/election/72141119156781069-core_node5-n_0000000000
[junit4] 2> 2 /solr/collections/raceDeleteReplica_true/leader_elect/shard1/election/72141119156781063-core_node4-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/live_nodes
[junit4] 2> 11 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_FD8F42273B98DC71-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=it-CH, timezone=America/Argentina/Cordoba
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=56156496,total=163094528
[junit4] 2> NOTE: All tests run in this JVM: [DeleteReplicaTest, DeleteReplicaTest]
[junit4] Completed [4/5 (1!)] on J0 in 138.28s, 7 tests, 1 failure, 1 error <<< FAILURES!
[junit4]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] OK 10.1s J1 | DeleteReplicaTest.deleteReplicaFromClusterState
[junit4] OK 4.32s J1 | DeleteReplicaTest.deleteReplicaByCount
[junit4] OK 6.31s J1 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
[junit4] OK 7.38s J1 | DeleteReplicaTest.deleteReplicaOnIndexing
[junit4] OK 4.47s J1 | DeleteReplicaTest.deleteLiveReplicaTest
[junit4] OK 40.3s J1 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
[junit4] OK 4.72s J1 | DeleteReplicaTest.deleteReplicaByCountForAllShards
[junit4] Completed [5/5 (1!)] on J1 in 99.73s, 7 tests
[junit4]
[junit4]
[junit4] Tests with failures [seed: FD8F42273B98DC71]:
[junit4] - org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
[junit4] - org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards
[junit4]
[junit4]
[junit4] JVM J0: 0.93 .. 272.63 = 271.70s
[junit4] JVM J1: 0.93 .. 337.09 = 336.17s
[junit4] Execution time total: 5 minutes 37 seconds
[junit4] Tests summary: 5 suites, 35 tests, 1 error, 1 failure
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:1567: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:1092: There were test failures: 5 suites, 35 tests, 1 error, 1 failure [seed: FD8F42273B98DC71]
Total time: 5 minutes 39 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 1/5 failed: org.apache.solr.cloud.DeleteReplicaTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d37554e88ecfab2c274bbfd185856b8f737ea350, workspace=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX
[WARNINGS] Computing warning deltas based on reference build #941
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk-9) - Build # 944 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/944/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.handler.component.DistributedMLTComponentTest.test
Error Message:
Error from server at http://127.0.0.1:60782//collection1: ERROR: [doc=1] Error adding field 'lowerfilt1'='x' msg=Multiple values encountered for non multiValued copy field lowerfilt1and2: x
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:60782//collection1: ERROR: [doc=1] Error adding field 'lowerfilt1'='x' msg=Multiple values encountered for non multiValued copy field lowerfilt1and2: x
at __randomizedtesting.SeedInfo.seed([B6F2B5E9B482A0E6:3EA68A331A7ECD1E]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:156)
at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:483)
at org.apache.solr.BaseDistributedSearchTestCase.index(BaseDistributedSearchTestCase.java:476)
at org.apache.solr.handler.component.DistributedMLTComponentTest.test(DistributedMLTComponentTest.java:81)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12918 lines...]
[junit4] Suite: org.apache.solr.handler.component.DistributedMLTComponentTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/init-core-data-001
[junit4] 2> 314879 INFO (SUITE-DistributedMLTComponentTest-seed#[B6F2B5E9B482A0E6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 314880 INFO (SUITE-DistributedMLTComponentTest-seed#[B6F2B5E9B482A0E6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 314880 INFO (SUITE-DistributedMLTComponentTest-seed#[B6F2B5E9B482A0E6]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 314880 INFO (SUITE-DistributedMLTComponentTest-seed#[B6F2B5E9B482A0E6]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 315191 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/control/cores/collection1
[junit4] 2> 315193 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 315194 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 315194 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 315194 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 315194 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@414c6c0a{/,null,AVAILABLE}
[junit4] 2> 315196 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@36a0745d{HTTP/1.1,[http/1.1]}{127.0.0.1:60782}
[junit4] 2> 315196 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server Started @315287ms
[junit4] 2> 315196 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema-sql.xml, hostContext=/, hostPort=60782, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/control/cores}
[junit4] 2> 315196 ERROR (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-21T04:12:55.205202Z
[junit4] 2> 315197 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/control/solr.xml
[junit4] 2> 315199 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 315200 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 315201 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 315295 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 315295 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 315308 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 315316 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 315316 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 315317 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/control/cores
[junit4] 2> 315317 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 315318 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib, /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 315338 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 315357 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 315396 WARN (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 315396 WARN (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 315396 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 315396 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 315397 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 315397 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/control/cores/collection1/data/]
[junit4] 2> 315398 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=12.25, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=10.154346268978887, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.21165627411915
[junit4] 2> 315456 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 315456 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 315458 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 315458 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 315469 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=46.4833984375, floorSegmentMB=1.3037109375, forceMergeDeletesPctAllowed=28.877579940409845, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39062763549881596, deletesPctAllowed=28.706164786913426
[junit4] 2> 315471 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f544635[collection1] main]
[junit4] 2> 315471 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 315486 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 315575 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 315576 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 315576 INFO (coreLoadExecutor-2276-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617715344791568384
[junit4] 2> 315576 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 315576 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 315576 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 315577 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 315577 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 315578 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 315579 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 315579 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 315580 INFO (searcherExecutor-2277-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f544635[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 315927 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard0/cores/collection1
[junit4] 2> 315929 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 315930 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 315930 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 315930 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 315930 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3338dab5{/,null,AVAILABLE}
[junit4] 2> 315931 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2ab38b2d{HTTP/1.1,[http/1.1]}{127.0.0.1:60783}
[junit4] 2> 315931 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server Started @316022ms
[junit4] 2> 315931 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema-sql.xml, hostContext=/, hostPort=60783, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard0/cores}
[junit4] 2> 315932 ERROR (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 315932 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 315932 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 315932 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 315932 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 315932 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-21T04:12:55.940949Z
[junit4] 2> 315933 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard0/solr.xml
[junit4] 2> 315937 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 315937 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 315951 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 316121 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 316121 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 316137 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316146 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316146 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316148 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard0/cores
[junit4] 2> 316148 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 316149 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib, /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 316171 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 316183 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 316228 WARN (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 316229 WARN (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 316229 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 316229 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 316229 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316229 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard0/cores/collection1/data/]
[junit4] 2> 316249 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=12.25, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=10.154346268978887, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.21165627411915
[junit4] 2> 316363 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 316363 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 316365 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 316365 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 316366 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=46.4833984375, floorSegmentMB=1.3037109375, forceMergeDeletesPctAllowed=28.877579940409845, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39062763549881596, deletesPctAllowed=28.706164786913426
[junit4] 2> 316368 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@db901dc[collection1] main]
[junit4] 2> 316369 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 316386 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 316434 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 316434 INFO (coreLoadExecutor-2290-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617715345691246592
[junit4] 2> 316434 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 316435 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 316435 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 316435 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 316435 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 316436 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 316436 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 316436 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 316437 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 316438 INFO (searcherExecutor-2291-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@db901dc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 316802 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard1/cores/collection1
[junit4] 2> 316804 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 316805 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 316805 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 316805 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 316806 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ad527ef{/,null,AVAILABLE}
[junit4] 2> 316806 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6e013f3f{HTTP/1.1,[http/1.1]}{127.0.0.1:60785}
[junit4] 2> 316806 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server Started @316897ms
[junit4] 2> 316806 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema-sql.xml, hostContext=/, hostPort=60785, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard1/cores}
[junit4] 2> 316807 ERROR (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 316807 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 316807 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 316807 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 316807 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 316807 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-21T04:12:56.815921Z
[junit4] 2> 316808 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard1/solr.xml
[junit4] 2> 316812 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 316812 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 316813 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 316942 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 316942 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 316958 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316968 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316968 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 316972 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard1/cores
[junit4] 2> 316972 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 316973 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib, /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 316992 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 317004 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 317046 WARN (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 317046 WARN (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 317046 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 317047 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 317047 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 317047 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard1/cores/collection1/data/]
[junit4] 2> 317049 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=12.25, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=10.154346268978887, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.21165627411915
[junit4] 2> 317103 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 317103 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 317106 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 317106 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 317110 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=46.4833984375, floorSegmentMB=1.3037109375, forceMergeDeletesPctAllowed=28.877579940409845, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39062763549881596, deletesPctAllowed=28.706164786913426
[junit4] 2> 317112 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17963265[collection1] main]
[junit4] 2> 317112 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 317145 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 317253 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 317253 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 317254 INFO (coreLoadExecutor-2304-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617715346551078912
[junit4] 2> 317264 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 317264 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 317264 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 317276 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 317279 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 317281 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 317282 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 317282 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 317283 INFO (searcherExecutor-2305-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@17963265[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 317581 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard2/cores/collection1
[junit4] 2> 317583 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 317584 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 317584 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 317584 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 317585 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9c8f5ff{/,null,AVAILABLE}
[junit4] 2> 317585 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@54684525{HTTP/1.1,[http/1.1]}{127.0.0.1:60787}
[junit4] 2> 317586 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.Server Started @317677ms
[junit4] 2> 317586 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema-sql.xml, hostContext=/, hostPort=60787, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard2/cores}
[junit4] 2> 317586 ERROR (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 317587 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 317587 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.7.0
[junit4] 2> 317587 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 317587 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 317587 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-21T04:12:57.595670Z
[junit4] 2> 317588 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard2/solr.xml
[junit4] 2> 317591 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 317591 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 317593 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 317696 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 317697 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 317752 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 317768 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 317768 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 317771 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard2/cores
[junit4] 2> 317771 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 317773 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib, /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 317797 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 317814 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 317863 WARN (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 317863 WARN (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 317863 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 317863 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 317863 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@111a853
[junit4] 2> 317863 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001/tempDir-001/shard2/cores/collection1/data/]
[junit4] 2> 317866 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=12.25, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=10.154346268978887, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=45.21165627411915
[junit4] 2> 317931 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 317931 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 317933 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 317933 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 317934 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=46.4833984375, floorSegmentMB=1.3037109375, forceMergeDeletesPctAllowed=28.877579940409845, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39062763549881596, deletesPctAllowed=28.706164786913426
[junit4] 2> 317934 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4c577754[collection1] main]
[junit4] 2> 317935 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 317947 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 318005 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 318005 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 318005 INFO (coreLoadExecutor-2318-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617715347338559488
[junit4] 2> 318008 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 318010 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 318010 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 318010 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 318012 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 318013 INFO (qtp1846482142-4823) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1617715347344850944)} 0 2
[junit4] 2> 318014 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 318015 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 318016 INFO (qtp1680930920-4843) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1617715347349045248)} 0 1
[junit4] 2> 318018 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 318019 INFO (qtp945429181-4863) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1617715347352190976)} 0 1
[junit4] 2> 318021 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 318022 INFO (searcherExecutor-2319-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4c577754[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 318023 INFO (qtp1181652231-4883) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1617715347355336704)} 0 1
[junit4] 2> 318026 INFO (qtp1846482142-4819) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={wt=javabin&version=2}{} 0 0
[junit4] 2> 318026 ERROR (qtp1846482142-4819) [ x:collection1] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: ERROR: [doc=1] Error adding field 'lowerfilt1'='x' msg=Multiple values encountered for non multiValued copy field lowerfilt1and2: x
[junit4] 2> at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:215)
[junit4] 2> at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:102)
[junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:962)
[junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:341)
[junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:288)
[junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:235)
[junit4] 2> at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:67)
[junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:961)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1177)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:653)
[junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103)
[junit4] 2> at org.apache.solr.handler.loader.JavabinLoader$1.update(JavabinLoader.java:118)
[junit4] 2> at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:188)
[junit4] 2> at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readIterator(JavaBinUpdateRequestCodec.java:144)
[junit4] 2> at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:317)
[junit4] 2> at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:262)
[junit4] 2> at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readNamedList(JavaBinUpdateRequestCodec.java:130)
[junit4] 2> at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:282)
[junit4] 2> at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:262)
[junit4] 2> at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:184)
[junit4] 2> at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:195)
[junit4] 2> at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:129)
[junit4] 2> at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:71)
[junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
[junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2541)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:709)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:515)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:674)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:531)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Multiple values encountered for non multiValued copy field lowerfilt1and2: x
[junit4] 2> at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:192)
[junit4] 2> ... 60 more
[junit4] 2>
[junit4] 2> 318027 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.SolrTestCaseJ4 ###Ending test
[junit4] 2> 318028 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@36a0745d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 318028 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=119028309
[junit4] 2> 318028 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 318028 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6db3fda8: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@18318119
[junit4] 2> 318033 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 318033 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@aec6237: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@63b95c78
[junit4] 2> 318036 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 318036 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c5134b9: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ce1ffa7
[junit4] 2> 318036 INFO (coreCloseExecutor-2324-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b83ef37
[junit4] 2> 318037 INFO (coreCloseExecutor-2324-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=b83ef37
[junit4] 2> 318037 INFO (coreCloseExecutor-2324-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@348d3242: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@65e014ab
[junit4] 2> 318044 INFO (coreCloseExecutor-2324-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 318044 INFO (coreCloseExecutor-2324-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6f187fdb commitCommandVersion:0
[junit4] 2> 318104 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@414c6c0a{/,null,UNAVAILABLE}
[junit4] 2> 318104 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 318119 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2ab38b2d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 318119 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=232711708
[junit4] 2> 318119 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 318119 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4db334de: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1d6d8fd1
[junit4] 2> 318124 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 318124 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3495f52e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@63b95c78
[junit4] 2> 318127 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 318127 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61498248: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ce1ffa7
[junit4] 2> 318127 INFO (coreCloseExecutor-2326-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@371f5a53
[junit4] 2> 318127 INFO (coreCloseExecutor-2326-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=371f5a53
[junit4] 2> 318127 INFO (coreCloseExecutor-2326-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f8e3d46: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@2889d6d8
[junit4] 2> 318134 INFO (coreCloseExecutor-2326-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 318135 INFO (coreCloseExecutor-2326-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2271bda8 commitCommandVersion:0
[junit4] 2> 318150 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3338dab5{/,null,UNAVAILABLE}
[junit4] 2> 318150 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 318151 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6e013f3f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 318151 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2068636215
[junit4] 2> 318152 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 318152 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1fc46dda: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ee08377
[junit4] 2> 318156 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 318156 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ba42a45: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@63b95c78
[junit4] 2> 318159 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 318159 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10f5a858: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ce1ffa7
[junit4] 2> 318160 INFO (coreCloseExecutor-2328-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@16192730
[junit4] 2> 318160 INFO (coreCloseExecutor-2328-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=16192730
[junit4] 2> 318160 INFO (coreCloseExecutor-2328-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@512c91d1: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@59432357
[junit4] 2> 318167 INFO (coreCloseExecutor-2328-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 318167 INFO (coreCloseExecutor-2328-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@53bb4827 commitCommandVersion:0
[junit4] 2> 318175 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ad527ef{/,null,UNAVAILABLE}
[junit4] 2> 318175 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 318176 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@54684525{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 318177 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=470700524
[junit4] 2> 318177 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 318177 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@550ad043: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@32b6a2f0
[junit4] 2> 318183 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 318183 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46797cc7: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@63b95c78
[junit4] 2> 318187 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 318187 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5572a53c: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ce1ffa7
[junit4] 2> 318188 INFO (coreCloseExecutor-2330-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@dd25a65
[junit4] 2> 318188 INFO (coreCloseExecutor-2330-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=dd25a65
[junit4] 2> 318188 INFO (coreCloseExecutor-2330-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6370df5: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@76a9e8e6
[junit4] 2> 318198 INFO (coreCloseExecutor-2330-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 318198 INFO (coreCloseExecutor-2330-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7c518396 commitCommandVersion:0
[junit4] 2> 318207 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9c8f5ff{/,null,UNAVAILABLE}
[junit4] 2> 318207 INFO (TEST-DistributedMLTComponentTest.test-seed#[B6F2B5E9B482A0E6]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedMLTComponentTest -Dtests.method=test -Dtests.seed=B6F2B5E9B482A0E6 -Dtests.slow=true -Dtests.locale=lag-TZ -Dtests.timezone=Asia/Magadan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 3.34s J1 | DistributedMLTComponentTest.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:60782//collection1: ERROR: [doc=1] Error adding field 'lowerfilt1'='x' msg=Multiple values encountered for non multiValued copy field lowerfilt1and2: x
[junit4] > at __randomizedtesting.SeedInfo.seed([B6F2B5E9B482A0E6:3EA68A331A7ECD1E]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:156)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:483)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.index(BaseDistributedSearchTestCase.java:476)
[junit4] > at org.apache.solr.handler.component.DistributedMLTComponentTest.test(DistributedMLTComponentTest.java:81)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.component.DistributedMLTComponentTest_B6F2B5E9B482A0E6-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1108, maxMBSortInHeap=6.455955430133811, sim=RandomSimilarity(queryNorm=true): {}, locale=lag-TZ, timezone=Asia/Magadan
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=136412672,total=322961408
[junit4] 2> NOTE: All tests run in this JVM: [SolrCmdDistributorTest, ShufflingReplicaListTransformerTest, NodeLostTriggerTest, CSVRequestHandlerTest, JavabinLoaderTest, ScheduledTriggerIntegrationTest, TestSubQueryTransformerDistrib, SuggesterTest, XsltUpdateRequestHandlerTest, TestInPlaceUpdatesDistrib, TestFreeTextSuggestions, PeerSyncWithIndexFingerprintCachingTest, HdfsChaosMonkeySafeLeaderTest, TestLockTree, BasicAuthStandaloneTest, TestBlendedInfixSuggestions, MetricsHandlerTest, UninvertDocValuesMergePolicyTest, TestSimpleTrackingShardHandler, TestMergePolicyConfig, TestExactSharedStatsCache, CursorMarkTest, HdfsCollectionsAPIDistributedZkTest, TestSSLRandomization, SolrIndexMetricsTest, DistributedFacetPivotLongTailTest, OverriddenZkACLAndCredentialsProvidersTest, TestAuthorizationFramework, DocExpirationUpdateProcessorFactoryTest, ConfigSetsAPITest, TestSolrFieldCacheBean, TestFieldCacheSortRandom, SubstringBytesRefFilterTest, MoveReplicaHDFSTest, TestSimNodeAddedTrigger, TestNumericRangeQuery32, TestIndexSearcher, CurrencyFieldTypeTest, TestDocTermOrdsUninvertLimit, BitVectorTest, DistributedFacetExistsSmallTest, OpenExchangeRatesOrgProviderTest, DistribJoinFromCollectionTest, MissingSegmentRecoveryTest, TestUseDocValuesAsStored, TestValueSourceCache, TestSerializedLuceneMatchVersion, TestGraphTermsQParserPlugin, LeaderVoteWaitTimeoutTest, SolrMetricReporterTest, SolrCLIZkUtilsTest, ForceLeaderTest, TestJmxIntegration, TestNumericTerms32, TestConfigOverlay, SSLMigrationTest, DataDrivenBlockJoinTest, TestEmbeddedSolrServerAdminHandler, LIROnShardRestartTest, SharedFSAutoReplicaFailoverTest, DistributedDebugComponentTest, SearchHandlerTest, TestCollectionsAPIViaSolrCloudCluster, RecoveryAfterSoftCommitTest, MetricUtilsTest, TestSearcherReuse, TestManagedStopFilterFactory, HdfsThreadLeakTest, DistribCursorPagingTest, TestSQLHandler, DistributedMLTComponentTest]
[junit4] Completed [96/836 (1!)] on J1 in 3.35s, 1 test, 1 error <<< FAILURES!
[...truncated 44998 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/944/consoleText
[repro] Revision: bf591a04c52cd51a817837366be85f8e43058e1c
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=DistributedMLTComponentTest -Dtests.method=test -Dtests.seed=B6F2B5E9B482A0E6 -Dtests.slow=true -Dtests.locale=lag-TZ -Dtests.timezone=Asia/Magadan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] DistributedMLTComponentTest
[repro] ant compile-test
[...truncated 3609 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.DistributedMLTComponentTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=B6F2B5E9B482A0E6 -Dtests.slow=true -Dtests.locale=lag-TZ -Dtests.timezone=Asia/Magadan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 73 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.handler.component.DistributedMLTComponentTest
[repro] Exiting with code 0
[...truncated 70 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk-9) - Build # 943 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/943/
Java: 64bit/jdk-9 -XX:+UseCompressedOops -XX:+UseParallelGC
5 tests failed.
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 7 in https://127.0.0.1:56467/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:56467/solr
at __randomizedtesting.SeedInfo.seed([D786EC9FD0CE31DD:16769533FD9EFB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 7 in https://127.0.0.1:56780/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:56780/solr
at __randomizedtesting.SeedInfo.seed([D786EC9FD0CE31DD:16769533FD9EFB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 7 in https://127.0.0.1:56808/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:56808/solr
at __randomizedtesting.SeedInfo.seed([D786EC9FD0CE31DD:16769533FD9EFB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 7 in https://127.0.0.1:57095/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:57095/solr
at __randomizedtesting.SeedInfo.seed([D786EC9FD0CE31DD:16769533FD9EFB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestTlogReplica.testRecovery
Error Message:
Can not find doc 7 in https://127.0.0.1:64387/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:64387/solr
at __randomizedtesting.SeedInfo.seed([D786EC9FD0CE31DD:16769533FD9EFB7A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 14271 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/init-core-data-001
[junit4] 2> 2365332 WARN (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 2365332 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2365333 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 2365333 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2365334 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001
[junit4] 2> 2365334 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2365334 INFO (Thread-4641) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2365334 INFO (Thread-4641) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2365337 ERROR (Thread-4641) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2365442 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:64360
[junit4] 2> 2365453 INFO (zkConnectionManagerCallback-8775-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365460 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 2365460 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 9+181
[junit4] 2> 2365461 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2365461 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2365461 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2365462 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50f050e3{/solr,null,AVAILABLE}
[junit4] 2> 2365462 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@437c99cb{/solr,null,AVAILABLE}
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@44c73f4c{SSL,[ssl, http/1.1]}{127.0.0.1:64387}
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-1) [ ] o.e.j.s.Server Started @2365539ms
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a052976{SSL,[ssl, http/1.1]}{127.0.0.1:64388}
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64387}
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.e.j.s.Server Started @2365540ms
[junit4] 2> 2365463 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64388}
[junit4] 2> 2365464 ERROR (jetty-launcher-8772-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2365464 ERROR (jetty-launcher-8772-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.7.0
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.7.0
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T10:17:01.177400Z
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2365464 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-11-20T10:17:01.177426Z
[junit4] 2> 2365465 INFO (zkConnectionManagerCallback-8778-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365466 INFO (zkConnectionManagerCallback-8779-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365466 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2365466 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2365591 INFO (jetty-launcher-8772-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64360/solr
[junit4] 2> 2365592 INFO (zkConnectionManagerCallback-8783-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365597 INFO (zkConnectionManagerCallback-8785-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365783 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64387_solr
[junit4] 2> 2365785 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.c.Overseer Overseer (id=72143172801986564-127.0.0.1:64387_solr-n_0000000000) starting
[junit4] 2> 2365797 INFO (zkConnectionManagerCallback-8792-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2365803 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64360/solr ready
[junit4] 2> 2365805 INFO (OverseerStateUpdate-72143172801986564-127.0.0.1:64387_solr-n_0000000000) [n:127.0.0.1:64387_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:64387_solr
[junit4] 2> 2365807 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64387_solr
[junit4] 2> 2365810 INFO (zkCallback-8791-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2365810 INFO (zkCallback-8784-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2365886 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2365924 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64387.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2365984 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64387.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2365984 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64387.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2365985 INFO (jetty-launcher-8772-thread-1) [n:127.0.0.1:64387_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node1/.
[junit4] 2> 2366217 INFO (jetty-launcher-8772-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64360/solr
[junit4] 2> 2366219 INFO (zkConnectionManagerCallback-8797-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2366223 INFO (zkConnectionManagerCallback-8799-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2366272 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2366293 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2366293 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64388_solr
[junit4] 2> 2366302 INFO (zkCallback-8784-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2366303 INFO (zkCallback-8791-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2366303 INFO (zkCallback-8798-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2366353 INFO (zkConnectionManagerCallback-8806-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2366356 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2366359 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64360/solr ready
[junit4] 2> 2366360 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 2366411 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64388.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2366467 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64388.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2366468 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64388.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2366470 INFO (jetty-launcher-8772-thread-2) [n:127.0.0.1:64388_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node2/.
[junit4] 2> 2366597 INFO (zkConnectionManagerCallback-8809-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2366602 INFO (zkConnectionManagerCallback-8814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2366603 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2366605 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64360/solr ready
[junit4] 2> 2366618 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 2366632 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2366634 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] IGNOR/A 0.00s J1 | TestTlogReplica.testCreateDelete {seed=[D786EC9FD0CE31DD:CC961DD3263EC9ED]}
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
[junit4] IGNOR/A 0.00s J1 | TestTlogReplica.testCreateDelete {seed=[D786EC9FD0CE31DD:78C0A12F12FC02C1]}
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
[junit4] 2> 2366655 INFO (TEST-TestTlogReplica.testAddDocs-seed#[D786EC9FD0CE31DD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAddDocs
[junit4] 2> 2366658 INFO (qtp1564448736-28183) [n:127.0.0.1:64387_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_add_docs&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=3&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2366661 INFO (OverseerThreadFactory-12315-thread-1-processing-n:127.0.0.1:64387_solr) [n:127.0.0.1:64387_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection tlog_replica_test_add_docs
[junit4] 2> 2366769 WARN (OverseerThreadFactory-12315-thread-1-processing-n:127.0.0.1:64387_solr) [n:127.0.0.1:64387_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 3 on collection tlog_replica_test_add_docs is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 2366776 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2366794 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2366802 INFO (OverseerStateUpdate-72143172801986564-127.0.0.1:64387_solr-n_0000000000) [n:127.0.0.1:64387_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_add_docs",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_add_docs_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64388/solr",
[junit4] 2> "type":"TLOG",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2366810 INFO (OverseerStateUpdate-72143172801986564-127.0.0.1:64387_solr-n_0000000000) [n:127.0.0.1:64387_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_add_docs",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_add_docs_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64387/solr",
[junit4] 2> "type":"TLOG",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2366815 INFO (OverseerStateUpdate-72143172801986564-127.0.0.1:64387_solr-n_0000000000) [n:127.0.0.1:64387_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_add_docs",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_add_docs_shard1_replica_t4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64387/solr",
[junit4] 2> "type":"TLOG",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2367025 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 2367025 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2367026 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 2367026 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t4&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 2368044 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 2368044 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 2368044 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
[junit4] 2> 2368059 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_add_docs_shard1_replica_t2] Schema name=minimal
[junit4] 2> 2368059 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.IndexSchema [tlog_replica_test_add_docs_shard1_replica_t4] Schema name=minimal
[junit4] 2> 2368059 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_add_docs_shard1_replica_t1] Schema name=minimal
[junit4] 2> 2368060 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2368060 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_add_docs_shard1_replica_t2' using configuration from collection tlog_replica_test_add_docs, trusted=true
[junit4] 2> 2368061 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2368061 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2368061 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64387.solr.core.tlog_replica_test_add_docs.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_add_docs.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2368061 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_add_docs_shard1_replica_t4' using configuration from collection tlog_replica_test_add_docs, trusted=true
[junit4] 2> 2368061 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_add_docs_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node1/tlog_replica_test_add_docs_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node1/./tlog_replica_test_add_docs_shard1_replica_t2/data/]
[junit4] 2> 2368061 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_add_docs_shard1_replica_t1' using configuration from collection tlog_replica_test_add_docs, trusted=true
[junit4] 2> 2368062 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64388.solr.core.tlog_replica_test_add_docs.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_add_docs.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2368062 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_64387.solr.core.tlog_replica_test_add_docs.shard1.replica_t4' (registry 'solr.core.tlog_replica_test_add_docs.shard1.replica_t4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5fb74f1c
[junit4] 2> 2368062 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_add_docs_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node2/tlog_replica_test_add_docs_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node2/./tlog_replica_test_add_docs_shard1_replica_t1/data/]
[junit4] 2> 2368062 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrCore [[tlog_replica_test_add_docs_shard1_replica_t4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node1/tlog_replica_test_add_docs_shard1_replica_t4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-001/tempDir-001/node1/./tlog_replica_test_add_docs_shard1_replica_t4/data/]
[junit4] 2> 2368116 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2368116 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2368118 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2368118 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2368121 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@2d0bd5fd[tlog_replica_test_add_docs_shard1_replica_t4] main]
[junit4] 2> 2368123 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2368124 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2368124 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2368125 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2368125 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2368127 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2368127 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2368127 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617647657382051840
[junit4] 2> 2368129 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2368129 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2368129 INFO (searcherExecutor-12328-thread-1-processing-n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t4 c:tlog_replica_test_add_docs s:shard1 r:core_node6) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t4] Registered new searcher Searcher@2d0bd5fd[tlog_replica_test_add_docs_shard1_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2368131 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2368131 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2368134 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@7a5ec5f0[tlog_replica_test_add_docs_shard1_replica_t2] main]
[junit4] 2> 2368135 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cc155bb[tlog_replica_test_add_docs_shard1_replica_t1] main]
[junit4] 2> 2368137 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2368137 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to Terms{values={core_node6=0}, version=0}
[junit4] 2> 2368137 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2368138 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2368153 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2368154 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617647657410363392
[junit4] 2> 2368153 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2368154 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2368154 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617647657410363392
[junit4] 2> 2368155 INFO (searcherExecutor-12327-thread-1-processing-n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t2 c:tlog_replica_test_add_docs s:shard1 r:core_node5) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new searcher Searcher@7a5ec5f0[tlog_replica_test_add_docs_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2368156 INFO (searcherExecutor-12329-thread-1-processing-n:127.0.0.1:64388_solr x:tlog_replica_test_add_docs_shard1_replica_t1 c:tlog_replica_test_add_docs s:shard1 r:core_node3) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t1] Registered new searcher Searcher@1cc155bb[tlog_replica_test_add_docs_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2368159 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to Terms{values={core_node6=0, core_node5=0}, version=1}
[junit4] 2> 2368162 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to Terms{values={core_node6=0, core_node3=0, core_node5=0}, version=2}
[junit4] 2> 2368166 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2368166 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2368167 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/
[junit4] 2> 2368167 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_add_docs_shard1_replica_t4 url=https://127.0.0.1:64387/solr START replicas=[https://127.0.0.1:64388/solr/tlog_replica_test_add_docs_shard1_replica_t1/, https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t2/] nUpdates=100
[junit4] 2> 2368168 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_add_docs_shard1_replica_t4 url=https://127.0.0.1:64387/solr DONE. We have no versions. sync failed.
[junit4] 2> 2368173 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2368173 INFO (qtp57018780-28191) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2368173 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2368173 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2368173 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2368174 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkController tlog_replica_test_add_docs_shard1_replica_t4 stopping background replication from leader
[junit4] 2> 2368180 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/ shard1
[junit4] 2> 2368348 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2368352 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t4&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1326
[junit4] 2> 2368468 INFO (zkCallback-8784-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_add_docs/state.json] for collection [tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2369167 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ZkController tlog_replica_test_add_docs_shard1_replica_t2 starting background replication from leader
[junit4] 2> 2369167 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
[junit4] 2> 2369168 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ZkController tlog_replica_test_add_docs_shard1_replica_t1 starting background replication from leader
[junit4] 2> 2369168 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
[junit4] 2> 2369168 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2369168 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2369168 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/
[junit4] 2> 2369168 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 2369168 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2369172 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2369172 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/
[junit4] 2> 2369172 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2369172 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2369172 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2369172 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2369172 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 2369174 INFO (qtp1564448736-28179) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2149
[junit4] 2> 2369175 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b6188ae[tlog_replica_test_add_docs_shard1_replica_t2] main]
[junit4] 2> 2369176 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2369176 INFO (searcherExecutor-12327-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new searcher Searcher@1b6188ae[tlog_replica_test_add_docs_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2369176 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2369177 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2369177 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2369177 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2369177 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 2369178 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f24d29b[tlog_replica_test_add_docs_shard1_replica_t1] main]
[junit4] 2> 2369178 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2152
[junit4] 2> 2369179 INFO (searcherExecutor-12329-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t1] Registered new searcher Searcher@6f24d29b[tlog_replica_test_add_docs_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2369182 INFO (qtp1564448736-28183) [n:127.0.0.1:64387_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2369281 INFO (zkCallback-8798-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_add_docs/state.json] for collection [tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2369281 INFO (zkCallback-8784-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_add_docs/state.json] for collection [tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2370168 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 2370169 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c7f3880[tlog_replica_test_add_docs_shard1_replica_t2] main]
[junit4] 2> 2370170 INFO (searcherExecutor-12327-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new searcher Searcher@7c7f3880[tlog_replica_test_add_docs_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2370174 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 2370175 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1bc6aa68[tlog_replica_test_add_docs_shard1_replica_t1] main]
[junit4] 2> 2370177 INFO (searcherExecutor-12329-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t1] Registered new searcher Searcher@1bc6aa68[tlog_replica_test_add_docs_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2370186 INFO (qtp1564448736-28183) [n:127.0.0.1:64387_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_add_docs&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=3&wt=javabin&version=2} status=0 QTime=3528
[junit4] 2> 2370196 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to Terms{values={core_node6=1, core_node3=1, core_node5=1}, version=3}
[junit4] 2> 2370199 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/&wt=javabin&version=2}{add=[1 (1617647659546312704)]} 0 0
[junit4] 2> 2370199 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:64387/solr/tlog_replica_test_add_docs_shard1_replica_t4/&wt=javabin&version=2}{add=[1 (1617647659546312704)]} 0 1
[junit4] 2> 2370199 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1617647659546312704)]} 0 8
[junit4] 2> 2370213 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:64388/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 2370214 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:64388/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 2370215 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1617647659571478528,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2370215 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@29ccfe20 commitCommandVersion:1617647659571478528
[junit4] 2> 2370234 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@7189ff7a[tlog_replica_test_add_docs_shard1_replica_t4] main]
[junit4] 2> 2370234 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2370236 INFO (searcherExecutor-12328-thread-1-processing-n:127.0.0.1:64387_solr x:tlog_replica_test_add_docs_shard1_replica_t4 c:tlog_replica_test_add_docs s:shard1 r:core_node6) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t4] Registered new searcher Searcher@7189ff7a[tlog_replica_test_add_docs_shard1_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.7.0):C1)))}
[junit4] 2> 2370236 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:64388/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 21
[junit4] 2> 2370237 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_add_docs:5&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 29
[junit4] 2> 2370242 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 2370250 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370356 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370458 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370566 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370669 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370670 INFO (OverseerCollectionConfigSetProcessor-72143172801986564-127.0.0.1:64387_solr-n_0000000000) [n:127.0.0.1:64387_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2370771 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370882 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2370993 INFO (qtp57018780-28192) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2371104 INFO (qtp57018780-28188) [n:127.0.0.1:64388_solr c:tlog_replica_test_add_docs s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2371179 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2371179 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2371179 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2371179 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2371179 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1542709025928
[junit4] 2> 2371179 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1542709025928
[junit4] 2> 2371179 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2371179 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2371179 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2371179 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2371179 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2371179 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2371181 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 2371181 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Number of files in latest index in master: 13
[junit4] 2> 2371181 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 2371181 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Number of files in latest index in master: 13
[junit4] 2> 2371182 INFO (indexFetcher-12343-thread-1) [ ] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@6e69a962 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67ea1db3)
[junit4] 2> 2371182 INFO (indexFetcher-12345-thread-1) [ ] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@3b38642e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@297548bc)
[junit4] 2> 2371182 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371183 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371185 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371185 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371186 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_1.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371186 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_1.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371187 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_1.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371187 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_1.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371188 INFO (qtp1564448736-28181) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371188 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371189 INFO (qtp1564448736-28185) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371189 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add_docs_shard1_replica_t4] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2371190 INFO (qtp1564448736-28184) [n:127.0.0.1:64387_solr c:tlog_replica_test_add_docs s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request [tlog_replica_test_add
[...truncated too long message...]
Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 329807 INFO (jetty-closer-266-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72143332475142169-127.0.0.1:57094_solr-n_0000000005) closing
[junit4] 2> 329808 INFO (OverseerStateUpdate-72143332475142169-127.0.0.1:57094_solr-n_0000000005) [n:127.0.0.1:57094_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:57094_solr
[junit4] 2> 329809 WARN (OverseerAutoScalingTriggerThread-72143332475142169-127.0.0.1:57094_solr-n_0000000005) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 329811 INFO (jetty-closer-266-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:57095_solr
[junit4] 2> 329813 INFO (jetty-closer-266-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 329815 INFO (zkCallback-393-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 329815 INFO (zkCallback-386-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 329815 INFO (zkCallback-386-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57095_solr
[junit4] 2> 331324 WARN (zkCallback-368-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 331325 INFO (jetty-closer-266-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6001acc4{/solr,null,UNAVAILABLE}
[junit4] 2> 331325 INFO (jetty-closer-266-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 337125 ERROR (recoveryExecutor-383-thread-1-processing-n:127.0.0.1:57095_solr x:tlog_replica_test_recovery_shard1_replica_t2 c:tlog_replica_test_recovery s:shard1 r:core_node4) [n:127.0.0.1:57095_solr c:tlog_replica_test_recovery s:shard1 r:core_node4 x:tlog_replica_test_recovery_shard1_replica_t2] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:tlog_replica_test_recovery_shard1_replica_t2
[junit4] 2> 337129 INFO (jetty-closer-266-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4eb59965{/solr,null,UNAVAILABLE}
[junit4] 2> 337130 INFO (jetty-closer-266-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 337131 ERROR (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 337131 INFO (SUITE-TestTlogReplica-seed#[D786EC9FD0CE31DD]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57092 57092
[junit4] 2> 337294 INFO (Thread-152) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57092 57092
[junit4] 2> 337477 WARN (Thread-152) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/configs/conf
[junit4] 2> 31 /solr/collections/tlog_replica_test_create_delete/terms/shard2
[junit4] 2> 31 /solr/collections/tlog_replica_test_create_delete/terms/shard1
[junit4] 2> 18 /solr/collections/tlog_replica_test_recovery/terms/shard1
[junit4] 2> 18 /solr/collections/tlog_replica_test_remove_leader/terms/shard1
[junit4] 2> 17 /solr/collections/tlog_replica_test_kill_leader/terms/shard1
[junit4] 2> 15 /solr/aliases.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_basic_leader_election/terms/shard1
[junit4] 2> 15 /solr/collections/tlog_replica_test_kill_tlog_replica/terms/shard1
[junit4] 2> 13 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/terms/shard1
[junit4] 2> 11 /solr/collections/tlog_replica_test_add_docs/terms/shard1
[junit4] 2> 11 /solr/collections/tlog_replica_test_real_time_get/terms/shard1
[junit4] 2> 11 /solr/collections/tlog_replica_test_only_leader_indexes/terms/shard1
[junit4] 2> 9 /solr/collections/tlog_replica_test_delete_by_id/terms/shard1
[junit4] 2> 8 /solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard2
[junit4] 2> 7 /solr/security.json
[junit4] 2> 7 /solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 15 /solr/clusterstate.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 11 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 9 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 8 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 8 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 8 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 5 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 5 /solr/overseer_elect/election/72143332475142150-127.0.0.1:57095_solr-n_0000000000
[junit4] 2> 4 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72143332475142150-core_node7-n_0000000001
[junit4] 2> 4 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/72143332475142150-core_node13-n_0000000001
[junit4] 2> 3 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 3 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 3 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 3 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72143332475142148-core_node9-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/72143332475142169-core_node3-n_0000000000
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 15 /solr/live_nodes
[junit4] 2> 15 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_D786EC9FD0CE31DD-003
[junit4] 2> Nov 20, 2018 10:59:24 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {foo=PostingsFormat(name=Memory), title_s=PostingsFormat(name=Memory), id=PostingsFormat(name=Memory), foo_s=PostingsFormat(name=Memory)}, docValues:{_version_=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70), inplace_updatable_int=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=447, maxMBSortInHeap=7.817612013645664, sim=RandomSimilarity(queryNorm=false): {}, locale=gl-ES, timezone=Asia/Novosibirsk
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=98264584,total=284164096
[junit4] 2> NOTE: All tests run in this JVM: [TestTlogReplica, TestTlogReplica, TestTlogReplica]
[junit4] Completed [5/5 (5!)] on J0 in 107.45s, 13 tests, 1 failure <<< FAILURES!
[...truncated 14 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:1567: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:1092: There were test failures: 5 suites, 65 tests, 5 failures [seed: D786EC9FD0CE31DD]
Total time: 5 minutes 41 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=a4e95f39be9d7f107b9027eb950775dc59406932, workspace=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX
[WARNINGS] Computing warning deltas based on reference build #942
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2