You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/01/25 00:21:04 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-11.0.6) - Build #
5566 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5566/
Java: 64bit/jdk-11.0.6 -XX:+UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: org.apache.solr.cloud.PeerSyncReplicationTest.test
Error Message:
expected:<154> but was:<152>
Stack Trace:
java.lang.AssertionError: expected:<154> but was:<152>
at __randomizedtesting.SeedInfo.seed([EB85460B79A7F5C9:63D179D1D75B9831]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at org.junit.Assert.assertEquals(Assert.java:631)
at org.apache.solr.cloud.PeerSyncReplicationTest.test(PeerSyncReplicationTest.java:154)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
FAILED: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
Error Message:
Failed while waiting for active collection Timeout waiting to see state for collection=testStopAllStartAllCollection :DocCollection(testStopAllStartAllCollection//collections/testStopAllStartAllCollection/state.json/25)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testStopAllStartAllCollection_shard1_replica_n1", "base_url":"http://127.0.0.1:54761/solr", "node_name":"127.0.0.1:54761_solr", "state":"active", "type":"NRT", "force_set_state":"false"}, "core_node5":{ "core":"testStopAllStartAllCollection_shard1_replica_n2", "base_url":"http://127.0.0.1:54716/solr", "node_name":"127.0.0.1:54716_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testStopAllStartAllCollection_shard2_replica_n4", "base_url":"http://127.0.0.1:54748/solr", "node_name":"127.0.0.1:54748_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node8":{ "core":"testStopAllStartAllCollection_shard2_replica_n6", "base_url":"http://127.0.0.1:54769/solr", "node_name":"127.0.0.1:54769_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} Live Nodes: [127.0.0.1:54545_solr, 127.0.0.1:54716_solr, 127.0.0.1:54748_solr, 127.0.0.1:54761_solr, 127.0.0.1:54769_solr] Last available state: DocCollection(testStopAllStartAllCollection//collections/testStopAllStartAllCollection/state.json/25)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testStopAllStartAllCollection_shard1_replica_n1", "base_url":"http://127.0.0.1:54761/solr", "node_name":"127.0.0.1:54761_solr", "state":"active", "type":"NRT", "force_set_state":"false"}, "core_node5":{ "core":"testStopAllStartAllCollection_shard1_replica_n2", "base_url":"http://127.0.0.1:54716/solr", "node_name":"127.0.0.1:54716_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testStopAllStartAllCollection_shard2_replica_n4", "base_url":"http://127.0.0.1:54748/solr", "node_name":"127.0.0.1:54748_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node8":{ "core":"testStopAllStartAllCollection_shard2_replica_n6", "base_url":"http://127.0.0.1:54769/solr", "node_name":"127.0.0.1:54769_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.RuntimeException: Failed while waiting for active collection
Timeout waiting to see state for collection=testStopAllStartAllCollection :DocCollection(testStopAllStartAllCollection//collections/testStopAllStartAllCollection/state.json/25)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testStopAllStartAllCollection_shard1_replica_n1",
"base_url":"http://127.0.0.1:54761/solr",
"node_name":"127.0.0.1:54761_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false"},
"core_node5":{
"core":"testStopAllStartAllCollection_shard1_replica_n2",
"base_url":"http://127.0.0.1:54716/solr",
"node_name":"127.0.0.1:54716_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testStopAllStartAllCollection_shard2_replica_n4",
"base_url":"http://127.0.0.1:54748/solr",
"node_name":"127.0.0.1:54748_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node8":{
"core":"testStopAllStartAllCollection_shard2_replica_n6",
"base_url":"http://127.0.0.1:54769/solr",
"node_name":"127.0.0.1:54769_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
Live Nodes: [127.0.0.1:54545_solr, 127.0.0.1:54716_solr, 127.0.0.1:54748_solr, 127.0.0.1:54761_solr, 127.0.0.1:54769_solr]
Last available state: DocCollection(testStopAllStartAllCollection//collections/testStopAllStartAllCollection/state.json/25)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testStopAllStartAllCollection_shard1_replica_n1",
"base_url":"http://127.0.0.1:54761/solr",
"node_name":"127.0.0.1:54761_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false"},
"core_node5":{
"core":"testStopAllStartAllCollection_shard1_replica_n2",
"base_url":"http://127.0.0.1:54716/solr",
"node_name":"127.0.0.1:54716_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testStopAllStartAllCollection_shard2_replica_n4",
"base_url":"http://127.0.0.1:54748/solr",
"node_name":"127.0.0.1:54748_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node8":{
"core":"testStopAllStartAllCollection_shard2_replica_n6",
"base_url":"http://127.0.0.1:54769/solr",
"node_name":"127.0.0.1:54769_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([EB85460B79A7F5C9:9DBB5978389058E6]:0)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForActiveCollection(MiniSolrCloudCluster.java:761)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForActiveCollection(MiniSolrCloudCluster.java:767)
at org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll(TestCollectionsAPIViaSolrCloudCluster.java:304)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Build Log:
[...truncated 14942 lines...]
[junit4] Suite: org.apache.solr.cloud.PeerSyncReplicationTest
[junit4] 2> 1292162 INFO (SUITE-PeerSyncReplicationTest-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/data-dir-130-001
[junit4] 2> 1292162 INFO (SUITE-PeerSyncReplicationTest-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1292164 INFO (SUITE-PeerSyncReplicationTest-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1292164 INFO (SUITE-PeerSyncReplicationTest-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1292164 INFO (SUITE-PeerSyncReplicationTest-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /dc_/
[junit4] 2> 1292170 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer Overriding violation report action to: IGNORE
[junit4] 2> 1292170 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1292171 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1292171 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1292274 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer start zk server on port:50889
[junit4] 2> 1292274 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:50889
[junit4] 2> 1292274 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:50889
[junit4] 2> 1292274 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 50889
[junit4] 2> 1292281 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1292292 INFO (zkConnectionManagerCallback-5326-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1292293 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1292314 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1292327 INFO (zkConnectionManagerCallback-5328-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1292327 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1292337 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1292344 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1292351 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1292358 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1292365 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1292371 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1292378 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1292385 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1292389 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1292395 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1292400 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1292407 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1293524 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1293524 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1293524 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1293524 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 1293542 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1293545 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1293547 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1293554 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2a5e575{/dc_,null,AVAILABLE}
[junit4] 2> 1293565 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6559974b{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:50896}
[junit4] 2> 1293565 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.s.Server Started @1293635ms
[junit4] 2> 1293565 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dc_, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/tempDir-001/control/data, hostPort=50896, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/control-001/cores}
[junit4] 2> 1293566 ERROR (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1293566 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1293566 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1293566 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1293566 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1293566 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-24T23:36:41.398776Z
[junit4] 2> 1293574 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1293579 INFO (zkConnectionManagerCallback-5330-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1293579 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1293710 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1293710 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/control-001/solr.xml
[junit4] 2> 1293712 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1293712 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1293713 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1293765 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1293767 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@78e65062[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1293767 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@78e65062[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1293777 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5c90e5a5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1293777 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5c90e5a5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1293779 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50889/solr
[junit4] 2> 1293789 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1293798 INFO (zkConnectionManagerCallback-5337-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1293798 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1293910 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1293920 INFO (zkConnectionManagerCallback-5339-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1293922 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1295512 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50896_dc_
[junit4] 2> 1295514 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.Overseer Overseer (id=72063448319524868-127.0.0.1:50896_dc_-n_0000000000) starting
[junit4] 2> 1295539 INFO (OverseerStateUpdate-72063448319524868-127.0.0.1:50896_dc_-n_0000000000) [n:127.0.0.1:50896_dc_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:50896_dc_
[junit4] 2> 1295543 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50896_dc_
[junit4] 2> 1295566 INFO (OverseerStateUpdate-72063448319524868-127.0.0.1:50896_dc_-n_0000000000) [n:127.0.0.1:50896_dc_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1295575 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1295576 WARN (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1295597 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1295624 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1295636 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1295636 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1295638 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [n:127.0.0.1:50896_dc_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/control-001/cores
[junit4] 2> 1295658 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1295662 INFO (zkConnectionManagerCallback-5348-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1295662 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1295665 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1295669 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50889/solr ready
[junit4] 2> 1295671 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50896_dc_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1295682 INFO (OverseerThreadFactory-4795-thread-1-processing-n:127.0.0.1:50896_dc_) [n:127.0.0.1:50896_dc_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1295832 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1295833 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1296890 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1296910 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1297081 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1297207 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 1297207 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1297207 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1297228 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8392136776516954]
[junit4] 2> 1297271 WARN (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1297442 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1297442 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=1000 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1297443 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1297443 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1297444 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@14c5944c
[junit4] 2> 1297446 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@56c61fab[control_collection_shard1_replica_n1] main]
[junit4] 2> 1297451 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1297452 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1297452 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1297452 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1656654665124675584
[junit4] 2> 1297456 INFO (searcherExecutor-4800-thread-1-processing-n:127.0.0.1:50896_dc_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@56c61fab[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1297475 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1297475 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 1297491 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1297492 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1297492 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50896/dc_/control_collection_shard1_replica_n1/
[junit4] 2> 1297492 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1297493 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:50896/dc_/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1297493 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72063448319524868-core_node2-n_0000000000
[junit4] 2> 1297501 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50896/dc_/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1297607 INFO (zkCallback-5338-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1297607 INFO (zkCallback-5338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1297610 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1297622 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1789
[junit4] 2> 1297629 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1297687 INFO (OverseerCollectionConfigSetProcessor-72063448319524868-127.0.0.1:50896_dc_-n_0000000000) [n:127.0.0.1:50896_dc_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1297729 INFO (zkCallback-5338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1297729 INFO (zkCallback-5338-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1297729 INFO (zkCallback-5338-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1297734 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50896_dc_&wt=javabin&version=2} status=0 QTime=2062
[junit4] 2> 1297735 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 1297860 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1297870 INFO (zkConnectionManagerCallback-5354-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1297870 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1297876 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1297886 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50889/solr ready
[junit4] 2> 1297887 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1297888 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1297911 INFO (OverseerThreadFactory-4795-thread-2-processing-n:127.0.0.1:50896_dc_) [n:127.0.0.1:50896_dc_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1298146 WARN (OverseerThreadFactory-4795-thread-2-processing-n:127.0.0.1:50896_dc_) [n:127.0.0.1:50896_dc_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1298152 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1298158 INFO (qtp853417314-16166) [n:127.0.0.1:50896_dc_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=269
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 1298164 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1298165 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=3
[junit4] 2> 1298165 INFO (watches-5351-thread-1) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 1298165 INFO (watches-5351-thread-1) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1298879 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001 of type NRT for shard1
[junit4] 2> 1298881 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1298881 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1298881 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1298881 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 1298885 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1298885 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1298885 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1298886 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55423e58{/dc_,null,AVAILABLE}
[junit4] 2> 1298887 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@a3b6976{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:50994}
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.Server Started @1298958ms
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dc_, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/tempDir-001/jetty1, hostPort=50994, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001/cores}
[junit4] 2> 1298888 ERROR (closeThreadPool-5355-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1298888 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-24T23:36:46.720569Z
[junit4] 2> 1298889 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1298894 INFO (zkConnectionManagerCallback-5357-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1298894 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1299005 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1299005 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001/solr.xml
[junit4] 2> 1299007 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1299007 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1299007 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1299057 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1299059 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5eac3485[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299059 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5eac3485[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299063 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@77c271ff[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299063 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@77c271ff[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299064 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50889/solr
[junit4] 2> 1299067 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1299075 INFO (zkConnectionManagerCallback-5364-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1299075 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1299185 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1299190 INFO (zkConnectionManagerCallback-5366-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1299190 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1299217 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1299240 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.ZkController Publish node=127.0.0.1:50994_dc_ as DOWN
[junit4] 2> 1299245 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1299245 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50994_dc_
[junit4] 2> 1299254 INFO (zkCallback-5353-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1299255 INFO (zkCallback-5338-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1299255 INFO (zkCallback-5365-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1299268 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1299268 WARN (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1299332 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1299396 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1299410 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1299410 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1299413 INFO (closeThreadPool-5355-thread-1) [n:127.0.0.1:50994_dc_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001/cores
[junit4] 2> 1299448 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50994_dc_
[junit4] 2> 1299645 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-2-001 of type NRT for shard1
[junit4] 2> 1299646 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1299646 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1299646 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1299646 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 1299649 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1299649 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1299649 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1299649 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@990f825{/dc_,null,AVAILABLE}
[junit4] 2> 1299650 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1f307ac1{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:51002}
[junit4] 2> 1299650 INFO (closeThreadPool-5355-thread-1) [ ] o.e.j.s.Server Started @1299721ms
[junit4] 2> 1299650 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dc_, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/tempDir-001/jetty2, hostPort=51002, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 1299651 ERROR (closeThreadPool-5355-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1299651 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1299651 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1299651 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1299651 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1299651 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-24T23:36:47.483265Z
[junit4] 2> 1299652 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1299656 INFO (zkConnectionManagerCallback-5372-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1299656 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1299761 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1299761 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-2-001/solr.xml
[junit4] 2> 1299763 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1299763 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1299771 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1299905 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1299906 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6ca517a9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299907 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6ca517a9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299912 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6a0faab1[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299912 WARN (closeThreadPool-5355-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6a0faab1[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1299913 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50889/solr
[junit4] 2> 1299914 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1299918 INFO (OverseerCollectionConfigSetProcessor-72063448319524868-127.0.0.1:50896_dc_-n_0000000000) [n:127.0.0.1:50896_dc_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1299919 INFO (zkConnectionManagerCallback-5379-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1299919 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1300009 INFO (TEST-PeerSyncReplicationTest.test-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-3-001 of type NRT for shard1
[junit4] 2> 1300010 WARN (closeThreadPool-5355-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1300010 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1300010 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1300010 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 1300012 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1300012 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1300012 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1300013 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@378e2c20{/dc_,null,AVAILABLE}
[junit4] 2> 1300013 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3ae20270{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:51008}
[junit4] 2> 1300013 INFO (closeThreadPool-5355-thread-2) [ ] o.e.j.s.Server Started @1300084ms
[junit4] 2> 1300013 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/dc_, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/tempDir-001/jetty3, hostPort=51008, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-3-001/cores}
[junit4] 2> 1300014 ERROR (closeThreadPool-5355-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1300014 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1300014 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1300014 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1300014 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1300014 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-24T23:36:47.846524Z
[junit4] 2> 1300015 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1300019 INFO (zkConnectionManagerCallback-5381-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1300019 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1300024 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1300027 INFO (zkConnectionManagerCallback-5383-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1300027 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1300043 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1300054 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:51002_dc_ as DOWN
[junit4] 2> 1300057 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1300057 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51002_dc_
[junit4] 2> 1300061 INFO (zkCallback-5338-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1300062 INFO (zkCallback-5365-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1300062 INFO (zkCallback-5353-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1300062 INFO (zkCallback-5382-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1300066 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1300067 WARN (closeThreadPool-5355-thread-1) [ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1300086 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1300107 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300115 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300115 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300116 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-2-001/cores
[junit4] 2> 1300125 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1300125 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-3-001/solr.xml
[junit4] 2> 1300128 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1300128 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1300128 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1300142 INFO (closeThreadPool-5355-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51002_dc_
[junit4] 2> 1300377 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1300378 WARN (closeThreadPool-5355-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@586e106e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1300378 WARN (closeThreadPool-5355-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@586e106e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1300380 WARN (closeThreadPool-5355-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1afc7aa5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1300380 WARN (closeThreadPool-5355-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1afc7aa5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1300381 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50889/solr
[junit4] 2> 1300382 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1300385 INFO (zkConnectionManagerCallback-5394-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1300385 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1300492 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1300494 INFO (zkConnectionManagerCallback-5396-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1300494 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1300515 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1300539 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.ZkController Publish node=127.0.0.1:51008_dc_ as DOWN
[junit4] 2> 1300542 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1300543 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51008_dc_
[junit4] 2> 1300551 INFO (zkCallback-5353-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1300553 INFO (zkCallback-5338-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1300554 INFO (zkCallback-5395-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1300555 INFO (zkCallback-5365-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1300564 INFO (zkCallback-5382-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1300581 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1300582 WARN (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1300638 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1300676 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300684 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300685 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1300686 INFO (closeThreadPool-5355-thread-2) [n:127.0.0.1:51008_dc_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-3-001/cores
[junit4] 2> 1300725 INFO (closeThreadPool-5355-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51008_dc_
[junit4] 2> 1300729 INFO (qtp853417314-16165) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:50994_dc_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1300729 INFO (qtp853417314-16168) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51002_dc_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1300729 INFO (qtp853417314-16167) [n:127.0.0.1:50896_dc_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51008_dc_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1300737 INFO (OverseerThreadFactory-4795-thread-3-processing-n:127.0.0.1:50896_dc_) [n:127.0.0.1:50896_dc_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:50994_dc_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 1300742 INFO (OverseerThreadFactory-4795-thread-3-processing-n:127.0.0.1:50896_dc_) [n:127.0.0.1:50896_dc_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 1300750 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1301780 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1301793 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=test
[junit4] 2> 1301942 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1302020 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 1302020 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ac0d68b
[junit4] 2> 1302020 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001/cores/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_EB85460B79A7F5C9-001/shard-1-001/cores/collection1_shard1_replica_n1/data/]
[junit4] 2> 1302026 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8392136776516954]
[junit4] 2> 1302560 WARN (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1302736 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1302736 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=1000 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1302743 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1302743 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1302744 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@32f2f6fe
[junit4] 2> 1302767 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7a1c9353[collection1_shard1_replica_n1] main]
[junit4] 2> 1302777 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1302778 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1302779 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1302780 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1656654670711488512
[junit4] 2> 1302782 INFO (searcherExecutor-4832-thread-1-processing-n:127.0.0.1:50994_dc_ x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@7a1c9353[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1302795 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1302795 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50994/dc_/collection1_shard1_replica_n1/
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:50994/dc_/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 1302808 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72063448319524873-core_node2-n_0000000000
[junit4] 2> 1302812 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50994/dc_/collection1_shard1_replica_n1/ shard1
[junit4] 2> 1302819 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1302825 INFO (qtp235203694-16224) [n:127.0.0.1:50994_dc_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collec
[...truncated too long message...]
INFO (jetty-closer-7505-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1743198 INFO (jetty-closer-7505-thread-4) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4a5fe41f{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1743199 INFO (jetty-closer-7505-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4fc3a91c{/solr,null,UNAVAILABLE}
[junit4] 2> 1743199 INFO (jetty-closer-7505-thread-4) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1743218 INFO (jetty-closer-7505-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2bc692d0{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1743219 INFO (jetty-closer-7505-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1e074b30{/solr,null,UNAVAILABLE}
[junit4] 2> 1743219 INFO (jetty-closer-7505-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1743298 INFO (jetty-closer-7505-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@44560d60{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1743299 INFO (jetty-closer-7505-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@17ddc2bf{/solr,null,UNAVAILABLE}
[junit4] 2> 1743299 INFO (jetty-closer-7505-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1743400 INFO (jetty-closer-7505-thread-5) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@77b01543{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 1743400 INFO (jetty-closer-7505-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1acc8a4{/solr,null,UNAVAILABLE}
[junit4] 2> 1743400 INFO (jetty-closer-7505-thread-5) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1743403 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1743611 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 5 /solr/packages.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 2 /solr/collections/testSolrCloudCollectionWithoutCores/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 2 /solr/collections/testSolrCloudCollectionWithoutCores/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72063477544845329-127.0.0.1:55079_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 29 /solr/live_nodes
[junit4] 2> 18 /solr/collections
[junit4] 2> 15 /solr/overseer/queue
[junit4] 2> 7 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1743618 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55068
[junit4] 2> 1743618 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55068
[junit4] 2> 1743618 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[EB85460B79A7F5C9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55068
[junit4] 2> 1743618 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[EB85460B79A7F5C9]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCollectionCreateWithoutCoresThenDelete
[junit4] 2> 1743619 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1743619 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55068
[junit4] 2> 1743619 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55068
[junit4] 2> 1743619 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[EB85460B79A7F5C9]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55068
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_EB85460B79A7F5C9-001
[junit4] 2> Jan 24, 2020 11:44:11 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@603dbf0a), locale=wae-CH, timezone=Europe/London
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=6,threads=1,free=229258640,total=524288000
[junit4] 2> NOTE: All tests run in this JVM: [TestLogWatcher, StatelessScriptUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, TestSchemaManager, ScheduledTriggerIntegrationTest, SpellPossibilityIteratorTest, QueryParsingTest, TestJoin, AlternateDirectoryTest, TestInPlaceUpdatesDistrib, RegexBytesRefFilterTest, TestConfigsApi, TestUseDocValuesAsStored2, TestExtendedDismaxParser, TestHttpShardHandlerFactory, IgnoreLargeDocumentProcessorFactoryTest, TestFieldResource, TestDistribDocBasedVersion, UpdateRequestProcessorFactoryTest, SolrSlf4jReporterTest, TestReplicationHandler, AdminHandlersProxyTest, RegexBoostProcessorTest, SOLR749Test, TestCharFilters, SuggesterTSTTest, CreateRoutedAliasTest, CdcrRequestHandlerTest, TestQueryUtils, CollectionTooManyReplicasTest, TestRequestStatusCollectionAPI, TermVectorComponentDistributedTest, TestFieldCacheSort, TestDirectoryFactory, DistributedQueueTest, DistributedIntervalFacetingTest, DimensionalRoutedAliasUpdateProcessorTest, TestSimpleTextCodec, TestCloudPseudoReturnFields, TestDistributedMissingSort, TestSolrQueryResponse, TestWithCollection, TestSolr4Spatial2, TestCloudSchemaless, TestMacroExpander, CdcrUpdateLogTest, TestManagedSynonymFilterFactory, TestTlogReplica, AddSchemaFieldsUpdateProcessorFactoryTest, TestLeaderElectionZkExpiry, SpatialFilterTest, CursorMarkTest, TestJsonFacets, TestMinMaxOnMultiValuedField, OverseerSolrResponseUnsafeSerializationTest, NodeLostTriggerIntegrationTest, TestPolicyCloud, TestManagedSchemaAPI, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, HttpSolrCallGetCoreTest, IndexSizeTriggerTest, TestTrieFacet, TestNumericTerms32, HdfsLockFactoryTest, PluginInfoTest, TestBlobHandler, ShardsWhitelistTest, RoutingToNodesWithPropertiesTest, TestBlendedInfixSuggestions, TestPhraseSuggestions, ClassificationUpdateProcessorFactoryTest, TestSolrQueryParser, ConfigureRecoveryStrategyTest, TestPrepRecovery, TestExactStatsCacheCloud, TestSimExtremeIndexing, EmbeddedSolrNoSerializeTest, TestComplexPhraseQParserPlugin, MigrateRouteKeyTest, TestPostingsSolrHighlighter, DistributedSuggestComponentTest, DistributedMLTComponentTest, XmlInterpolationTest, TestSearchPerf, AnalysisAfterCoreReloadTest, TestDistribPackageStore, HdfsUnloadDistributedZkTest, BitVectorTest, OverseerRolesTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, SliceStateTest, SolrCLIZkUtilsTest, SolrXmlInZkTest, SplitShardTest, TestCloudDeleteByQuery, TestConfigSetsAPI, TestRandomRequestDistribution, TestSSLRandomization, TestSolrCloudWithDelegationTokens, TestStressCloudBlindAtomicUpdates, ZkFailoverTest, AssignTest, AsyncCallRequestStatusResponseTest, CustomCollectionTest, TestCollectionsAPIViaSolrCloudCluster]
[junit4] Completed [582/900 (2!)] on J0 in 99.77s, 3 tests, 1 error <<< FAILURES!
[...truncated 53631 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5566/consoleText
[repro] Revision: 74e88deba78ea40f81c3072d6e014903773f4e92
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=PeerSyncReplicationTest -Dtests.method=test -Dtests.seed=EB85460B79A7F5C9 -Dtests.slow=true -Dtests.locale=fr-TN -Dtests.timezone=Asia/Tbilisi -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=TestCollectionsAPIViaSolrCloudCluster -Dtests.method=testStopAllStartAll -Dtests.seed=EB85460B79A7F5C9 -Dtests.slow=true -Dtests.locale=wae-CH -Dtests.timezone=Europe/London -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCollectionsAPIViaSolrCloudCluster
[repro] PeerSyncReplicationTest
[repro] ant compile-test
[...truncated 3408 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestCollectionsAPIViaSolrCloudCluster|*.PeerSyncReplicationTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=EB85460B79A7F5C9 -Dtests.slow=true -Dtests.locale=wae-CH -Dtests.timezone=Europe/London -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 116 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.PeerSyncReplicationTest
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-11.0.6) - Build #
5568 - Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5568/
Java: 64bit/jdk-11.0.6 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testReplay
Error Message:
Timeout waiting to see state for collection=collection1 :DocCollection(collection1//clusterstate.json/1)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0", "autoCreated":"true"}
Stack Trace:
java.util.concurrent.TimeoutException: Timeout waiting to see state for collection=collection1 :DocCollection(collection1//clusterstate.json/1)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0",
"autoCreated":"true"}
at __randomizedtesting.SeedInfo.seed([6928E9FF8B52F712:21E1E1BB65618669]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1757)
at org.apache.solr.cloud.OverseerTest.testReplay(OverseerTest.java:1254)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
FAILED: org.apache.solr.cloud.SystemCollectionCompatTest.testBackCompat
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:57940/solr/.system]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:57940/solr/.system]
at __randomizedtesting.SeedInfo.seed([6928E9FF8B52F712:19DD4A56EB9A5E64]:0)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.cloud.SystemCollectionCompatTest.setupSystemCollection(SystemCollectionCompatTest.java:118)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:976)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: https://127.0.0.1:57940/solr/.system
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
... 43 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1103)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:823)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 47 more
Build Log:
[...truncated 13848 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 534782 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.OverseerTest_6928E9FF8B52F712-001/data-dir-49-001
[junit4] 2> 534782 WARN (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 534782 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 534783 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 534783 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 534784 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 534784 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 534784 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 534885 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:65495
[junit4] 2> 534885 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:65495
[junit4] 2> 534885 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:65495
[junit4] 2> 534885 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 65495
[junit4] 2> 534898 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 534903 INFO (zkConnectionManagerCallback-3453-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534903 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 534910 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 534914 INFO (zkConnectionManagerCallback-3455-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 534914 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 534914 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 534914 INFO (SUITE-OverseerTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 534922 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStateChange
[junit4] 2> 535514 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 535517 INFO (zkConnectionManagerCallback-3459-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535518 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 535526 WARN (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7caf5141[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 535526 WARN (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7caf5141[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 535735 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 535739 INFO (zkConnectionManagerCallback-3466-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535740 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 535993 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 535994 INFO (zkConnectionManagerCallback-3471-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 535999 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 536037 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 536067 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 536072 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316930-127.0.0.1:65495_solr-n_0000000000) starting
[junit4] 2> 536154 WARN (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 536154 INFO (OverseerStateUpdate-72065785192316930-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 536192 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 536306 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 536653 INFO (closeThreadPool-3473-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065785192316930-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 536654 INFO (OverseerAutoScalingTriggerThread-72065785192316930-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 536655 INFO (OverseerStateUpdate-72065785192316930-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 536659 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 537349 INFO (TEST-OverseerTest.testStateChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStateChange
[junit4] 2> 537367 INFO (TEST-OverseerTest.testLatchWatcher-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLatchWatcher
[junit4] 2> 537491 INFO (TEST-OverseerTest.testLatchWatcher-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testLatchWatcher
[junit4] 2> 537511 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverseerFailure
[junit4] 2> 538555 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 538563 INFO (zkConnectionManagerCallback-3479-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 538564 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 538635 INFO (zkCallback-3478-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 538635 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 538635 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 538636 INFO (zkConnectionManagerCallback-3483-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 538638 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 538649 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@305ccd79[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 538649 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@305ccd79[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 538661 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 538665 INFO (zkConnectionManagerCallback-3490-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 538666 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 538673 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 538677 INFO (zkConnectionManagerCallback-3495-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 538677 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 538695 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 538711 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 538730 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 538744 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316934-127.0.0.1:65495_solr-n_0000000000) starting
[junit4] 2> 538842 INFO (OverseerStateUpdate-72065785192316934-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 538843 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 538868 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 538869 INFO (OverseerStateUpdate-72065785192316934-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 538875 INFO (zkConnectionManagerCallback-3500-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 538876 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 538907 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 538924 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 539080 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 539099 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316933-node1_core1-n_0000000000
[junit4] 2> 539124 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 539172 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 539185 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316933-node1_core1-n_0000000001
[junit4] 2> 539201 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 539375 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 539404 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316933-node1_core1-n_0000000002
[junit4] 2> 539441 WARN (OverseerStateUpdate-72065785192316934-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2384) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:350) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:220) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:259) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 539441 INFO (OverseerStateUpdate-72065785192316934-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 539452 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 539525 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 539526 INFO (zkConnectionManagerCallback-3502-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539526 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 539527 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316934-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 539527 INFO (OverseerAutoScalingTriggerThread-72065785192316934-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 539533 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7ee59735[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 539533 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7ee59735[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 539534 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 539538 INFO (zkConnectionManagerCallback-3509-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539538 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 539541 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 539543 INFO (zkConnectionManagerCallback-3514-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 539543 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 539555 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 539570 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 539580 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 539583 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316938-127.0.0.1:65495_solr-n_0000000001) starting
[junit4] 2> 539615 INFO (OverseerStateUpdate-72065785192316938-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 539618 WARN (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 539618 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.AbstractDistribZkTestBase verifyReplicaStatus (collection1) shard=shard1 coreNodeName=core_node1
[junit4] 2> 539625 INFO (OverseerStateUpdate-72065785192316938-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 539821 INFO (zkCallback-3499-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 539821 INFO (zkCallback-3501-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 539821 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 539821 INFO (zkCallback-3494-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 539822 INFO (zkCallback-3478-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 539822 INFO (zkCallback-3513-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 540391 INFO (closeThreadPool-3516-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065785192316934-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 540392 INFO (closeThreadPool-3516-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72065785192316938-127.0.0.1:65495_solr-n_0000000001) closing
[junit4] 2> 540392 INFO (OverseerStateUpdate-72065785192316938-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 540392 INFO (OverseerAutoScalingTriggerThread-72065785192316938-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 540397 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 541078 INFO (TEST-OverseerTest.testOverseerFailure-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerFailure
[junit4] 2> 541086 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardAssignment
[junit4] 2> 542015 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 542028 INFO (zkConnectionManagerCallback-3518-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 542028 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 542033 WARN (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@23a6e7f0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 542033 WARN (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@23a6e7f0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 542035 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 542041 INFO (zkConnectionManagerCallback-3525-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 542043 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 542046 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 542057 INFO (zkConnectionManagerCallback-3530-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 542057 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 542098 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 542143 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 542146 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316941-127.0.0.1:65495_solr-n_0000000000) starting
[junit4] 2> 542259 WARN (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 542260 INFO (OverseerStateUpdate-72065785192316941-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 542283 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 542291 INFO (zkConnectionManagerCallback-3534-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 542292 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 542362 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 542363 INFO (zkCallback-3533-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 542363 INFO (zkCallback-3529-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 542363 INFO (zkCallback-3517-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 542603 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 542664 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316944-127.0.0.1_core1-n_0000000000
[junit4] 2> 542856 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
[junit4] 2> 542873 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72065785192316944-127.0.0.1_core2-n_0000000000
[junit4] 2> 543062 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3
[junit4] 2> 543075 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard3/leader after winning as /collections/collection1/leader_elect/shard3/election/72065785192316944-127.0.0.1_core3-n_0000000000
[junit4] 2> 543218 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 543355 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
[junit4] 2> 543500 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3
[junit4] 2> 543522 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 543523 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 543523 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 543525 WARN (zkCallback-3533-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 543527 WARN (zkCallback-3533-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 543529 WARN (zkCallback-3533-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 543530 INFO (zkCallback-3529-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 543530 INFO (zkCallback-3533-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 543530 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 543530 INFO (zkCallback-3517-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 543967 INFO (closeThreadPool-3538-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065785192316941-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 543967 INFO (OverseerStateUpdate-72065785192316941-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 543968 INFO (OverseerAutoScalingTriggerThread-72065785192316941-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 543972 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 544183 INFO (TEST-OverseerTest.testShardAssignment-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testShardAssignment
[junit4] 2> 544193 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBadQueueItem
[junit4] 2> 544459 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 544463 INFO (zkConnectionManagerCallback-3540-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 544463 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 544468 WARN (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@76c807b3[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 544468 WARN (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@76c807b3[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 544470 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 544472 INFO (zkConnectionManagerCallback-3547-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 544472 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 544478 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 544482 INFO (zkConnectionManagerCallback-3552-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 544482 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 544508 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 544517 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 544522 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Overseer (id=72065785192316945-127.0.0.1:65495_solr-n_0000000000) starting
[junit4] 2> 544543 WARN (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 544544 INFO (OverseerStateUpdate-72065785192316945-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 544567 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 544570 INFO (zkConnectionManagerCallback-3556-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 544570 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 544618 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 544619 INFO (zkCallback-3551-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 544619 INFO (zkCallback-3555-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 544620 INFO (zkCallback-3539-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 544779 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 544792 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316948-127.0.0.1_core1-n_0000000000
[junit4] 2> 544948 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
[junit4] 2> 544953 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72065785192316948-127.0.0.1_core2-n_0000000000
[junit4] 2> 545072 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3
[junit4] 2> 545079 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard3/leader after winning as /collections/collection1/leader_elect/shard3/election/72065785192316948-127.0.0.1_core3-n_0000000000
[junit4] 2> 545195 ERROR (OverseerStateUpdate-72065785192316945-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 545202 ERROR (OverseerStateUpdate-72065785192316945-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"deletecore",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":""}
[junit4] 2> 545333 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/shard1
[junit4] 2> 545338 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/shard1/leader after winning as /collections/collection2/leader_elect/shard1/election/72065785192316948-127.0.0.1_core1-n_0000000000
[junit4] 2> 545458 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/shard2
[junit4] 2> 545463 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/shard2/leader after winning as /collections/collection2/leader_elect/shard2/election/72065785192316948-127.0.0.1_core2-n_0000000000
[junit4] 2> 545598 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/shard3
[junit4] 2> 545624 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/shard3/leader after winning as /collections/collection2/leader_elect/shard3/election/72065785192316948-127.0.0.1_core3-n_0000000000
[junit4] 2> 545761 INFO (zkCallback-3539-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 545761 INFO (zkCallback-3551-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 545762 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 545762 INFO (zkCallback-3555-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 546195 INFO (closeThreadPool-3560-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065785192316945-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 546196 INFO (OverseerStateUpdate-72065785192316945-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 546199 INFO (OverseerAutoScalingTriggerThread-72065785192316945-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 546225 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 546679 INFO (TEST-OverseerTest.testBadQueueItem-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBadQueueItem
[junit4] 2> 546693 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange
[junit4] 2> 546860 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546864 INFO (zkConnectionManagerCallback-3562-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546865 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546872 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@22aa296c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546872 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@22aa296c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546874 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546878 INFO (zkConnectionManagerCallback-3571-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546878 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546891 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546899 INFO (zkConnectionManagerCallback-3576-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546899 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546902 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5502b6f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546903 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5502b6f[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546906 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546909 INFO (zkConnectionManagerCallback-3581-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546909 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546927 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@52d4a8bf[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546927 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@52d4a8bf[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 546930 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546932 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 546937 INFO (zkConnectionManagerCallback-3588-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546937 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546945 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546948 INFO (zkConnectionManagerCallback-3593-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546948 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546949 INFO (Thread-612) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 546952 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72065785192316949-127.0.0.1:65495_solr-n_0000000000) starting
[junit4] 2> 546956 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 546971 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 546975 INFO (zkConnectionManagerCallback-3595-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 546975 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 546986 WARN (Thread-612) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 546987 INFO (Thread-612) [ ] o.a.s.c.OverseerTest Killing overseer.
[junit4] 2> 546988 INFO (OverseerStateUpdate-72065785192316949-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 546991 INFO (zkCallback-3580-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65495_solr
[junit4] 2> 547001 INFO (zkCallback-3580-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065785192316952-127.0.0.1:65495_solr-n_0000000001) starting
[junit4] 2> 547031 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547031 INFO (zkCallback-3594-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547032 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547033 WARN (zkCallback-3580-thread-1) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState.
[junit4] 2> 547033 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547037 INFO (OverseerStateUpdate-72065785192316952-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65495_solr
[junit4] 2> 547049 INFO (OverseerStateUpdate-72065785192316952-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547093 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547097 INFO (zkConnectionManagerCallback-3599-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547097 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547097 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72065785192316949-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 547097 INFO (OverseerAutoScalingTriggerThread-72065785192316949-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 547098 INFO (OverseerStateUpdate-72065785192316949-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer According to ZK I (id=72065785192316949-127.0.0.1:65495_solr-n_0000000000) am no longer a leader. propsId=null
[junit4] 2> 547098 INFO (OverseerStateUpdate-72065785192316949-127.0.0.1:65495_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65495_solr
[junit4] 2> 547103 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper
[junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:338) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:834) [?:?]
[junit4] 2> 547107 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@60887dfb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 547107 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@60887dfb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 547108 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547112 INFO (zkConnectionManagerCallback-3606-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547113 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547115 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547120 INFO (zkConnectionManagerCallback-3611-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547120 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547123 INFO (Thread-612) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547126 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 547181 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 547185 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316955-node1_core1-n_0000000000
[junit4] 2> 547343 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 547350 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316955-node1_core1-n_0000000001
[junit4] 2> 547353 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547357 INFO (zkConnectionManagerCallback-3613-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547357 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547395 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547405 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547405 INFO (zkCallback-3612-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547406 INFO (zkCallback-3594-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547406 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547406 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547406 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547407 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547433 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 547437 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316955-node1_core1-n_0000000002
[junit4] 2> 547559 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 547563 INFO (zkCallback-3612-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316959-node2_core4-n_0000000003
[junit4] 2> 547570 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547571 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547571 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547571 INFO (zkCallback-3594-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547571 INFO (zkCallback-3612-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547571 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547572 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547677 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547684 INFO (zkConnectionManagerCallback-3617-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547686 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547690 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547694 INFO (zkConnectionManagerCallback-3622-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547694 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547698 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547702 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 547708 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547712 INFO (zkConnectionManagerCallback-3624-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547712 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547724 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547733 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547733 INFO (zkCallback-3623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3612-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547734 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 547738 WARN (OverseerStateUpdate-72065785192316952-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.o.ClusterStateMutator Collection collection1 already exists. exit
[junit4] 2> 547740 INFO (Thread-612) [ ] o.a.s.c.OverseerTest Killing overseer.
[junit4] 2> 547848 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547850 INFO (zkConnectionManagerCallback-3628-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547850 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547855 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72065785192316949-127.0.0.1:65495_solr-n_0000000000) closing
[junit4] 2> 547858 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 547858 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@36d96818[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 547858 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@36d96818[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 547860 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547864 INFO (zkConnectionManagerCallback-3635-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547864 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547868 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 547872 INFO (zkConnectionManagerCallback-3640-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 547872 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 547872 INFO (zkCallback-3623-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316962-node1_core1-n_0000000004
[junit4] 2> 547876 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547877 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547878 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547878 INFO (zkCallback-3612-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547878 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547878 INFO (zkCallback-3621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547878 INFO (zkCallback-3623-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547879 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 547881 INFO (Thread-612) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 547986 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 548114 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 548122 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316962-node1_core1-n_0000000005
[junit4] 2> 548132 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 548138 INFO (zkConnectionManagerCallback-3642-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 548138 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 548159 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 548175 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548175 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548175 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548176 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548176 INFO (zkCallback-3623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548176 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548176 INFO (zkCallback-3641-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548176 INFO (zkCallback-3639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548177 INFO (zkCallback-3621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548192 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 548197 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316962-node1_core1-n_0000000006
[junit4] 2> 548220 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 548229 INFO (zkCallback-3641-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72065785192316966-node2_core4-n_0000000007
[junit4] 2> 548233 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548233 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548233 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548233 INFO (zkCallback-3621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548234 INFO (zkCallback-3623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548235 INFO (zkCallback-3639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548235 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548235 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548236 INFO (zkCallback-3641-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 548342 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 548345 INFO (zkConnectionManagerCallback-3646-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 548345 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 548349 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 548352 INFO (zkConnectionManagerCallback-3651-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 548352 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 548355 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 548358 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65495/solr ready
[junit4] 2> 548360 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 548363 INFO (zkConnectionManagerCallback-3653-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 548363 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 548373 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[6928E9FF8B52F712]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 548382 INFO (zkCallback-3454-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548382 INFO (zkCallback-3639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3592-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3610-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3650-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3575-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3652-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3641-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548383 INFO (zkCallback-3580-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 548387 WARN (OverseerStateUpdate-72065785192316952-127.0.0.1:65495_solr-n_0000000001) [ ] o.a.s.c.o.ClusterStateMutator Collection collection1 already exists. exit
[junit4] 2> 548
[...truncated too long message...]
th=/schema params={wt=javabin&version=2} status=0 QTime=136491
[junit4] 2> 1843595 INFO (qtp94672758-16309) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@52263a20
[junit4] 2> 1843595 WARN (qtp94672758-16309) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Interrupted while trying to obtain lock to modify reporters registry: solr.core..system.shard1.replica_n1
[junit4] 2> 1843595 INFO (qtp94672758-16309) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=SolrCore@52263a20
[junit4] 2> 1843596 INFO (qtp94672758-16309) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() .
[junit4] 2> 1843596 INFO (qtp94672758-16309) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@55e40926 commitCommandVersion:0
[junit4] 2> 1843596 WARN (managedSchemaExecutor-4941-thread-1-processing-n:127.0.0.1:57940_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:57940_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:57940/solr/.system_shard1_replica_n2/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:57940/solr/.system_shard1_replica_n2
[junit4] 2> 1843604 INFO (SUITE-SystemCollectionCompatTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1843811 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/collections/.system/terms/shard1
[junit4] 2> 4 /solr/configs/.system/managed-schema
[junit4] 2> 2 /solr/configs/.system
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/.system/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 24 /solr/collections/.system/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 26 /solr/overseer/queue
[junit4] 2> 18 /solr/collections
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 12 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1843814 INFO (SUITE-SystemCollectionCompatTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:57929
[junit4] 2> 1843814 INFO (SUITE-SystemCollectionCompatTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:57929
[junit4] 2> 1843814 INFO (SUITE-SystemCollectionCompatTest-seed#[6928E9FF8B52F712]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 57929
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.SystemCollectionCompatTest_6928E9FF8B52F712-001
[junit4] 2> Jan 25, 2020 9:52:46 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene84, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1d4c955), locale=luo-KE, timezone=Canada/Eastern
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=6,threads=1,free=170551320,total=451780608
[junit4] 2> NOTE: All tests run in this JVM: [ZkCollectionPropsCachingTest, TestDistributedGrouping, CollectionReloadTest, TestReRankQParserPlugin, TestNestedUpdateProcessor, SearchHandlerTest, HttpPartitionWithTlogReplicasTest, CdcrReplicationHandlerTest, TestUseDocValuesAsStored, RollingRestartTest, TestBinaryResponseWriter, OrderedExecutorTest, ProtectedTermFilterFactoryTest, TestReloadDeadlock, CreateCollectionCleanupTest, QueryEqualityTest, FieldAnalysisRequestHandlerTest, TestFunctionQuery, TestTlogReplayVsRecovery, MetricsHistoryWithAuthIntegrationTest, TestSolrCoreProperties, SearchHandlerTest, SampleTest, TestRetrieveFieldsOptimizer, SolrMetricManagerTest, CategoryRoutedAliasUpdateProcessorTest, DistribJoinFromCollectionTest, DefaultValueUpdateProcessorTest, ConcurrentDeleteAndCreateCollectionTest, DistributedFacetExistsSmallTest, TestSolrJ, ScheduledMaintenanceTriggerTest, AliasIntegrationTest, TestHighFrequencyDictionaryFactory, TestNumericTokenStream, TestReplicaProperties, ExternalFileFieldSortTest, TestDeleteCollectionOnDownNodes, TestConfigSetProperties, MoreLikeThisComponentTest, CachingDirectoryFactoryTest, SuggesterFSTTest, TestHttpServletCarrier, WrapperMergePolicyFactoryTest, TestLegacyNumericUtils, XsltUpdateRequestHandlerTest, PackageManagerCLITest, TestDistribIDF, ChaosMonkeyNothingIsSafeTest, TestRandomFlRTGCloud, TestStressThreadBackup, TestCloudManagedSchema, SuggestComponentTest, TestRestoreCore, TestTermsQParserPlugin, SolrLogAuditLoggerPluginTest, CurrencyRangeFacetCloudTest, ShardRoutingTest, HLLUtilTest, TestLegacyNumericRangeQueryBuilder, HdfsBasicDistributedZk2Test, SolrXmlInZkTest, TestDelegationWithHadoopAuth, SortSpecParsingTest, TestFieldCacheReopen, ZkNodePropsTest, TestInPlaceUpdateWithRouteField, TestWordDelimiterFilterFactory, TestPartialUpdateDeduplication, TestPerFieldSimilarity, UnloadDistributedZkTest, TestSolrCloudWithKerberosAlt, TestAnalyzedSuggestions, ConjunctionSolrSpellCheckerTest, TestCollectionAPIs, TestShardHandlerFactory, PreAnalyzedUpdateProcessorTest, SimpleMLTQParserTest, TestLegacyFieldCache, TestNoOpRegenerator, NodeAddedTriggerTest, SpellCheckCollatorWithCollapseTest, TestFaceting, DeleteReplicaTest, TestExactSharedStatsCacheCloud, DOMUtilTest, TestDocumentBuilder, TestGroupingSearch, TestHighlightDedupGrouping, TokenizerChainTest, TestLuceneIndexBackCompat, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ChaosMonkeySafeLeaderWithPullReplicasTest, DistributedQueueTest, ForceLeaderTest, ForceLeaderWithTlogReplicasTest, LeaderElectionContextKeyTest, LeaderElectionIntegrationTest, MoveReplicaHDFSFailoverTest, MoveReplicaTest, RecoveryZkTest, SplitShardTest, SystemCollectionCompatTest]
[junit4] Completed [507/900 (2!)] on J4 in 141.84s, 1 test, 1 error <<< FAILURES!
[...truncated 53906 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5568/consoleText
[repro] Revision: 127ce3e360ad88cb0a77a58d81eb09df00c04045
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=OverseerTest -Dtests.method=testReplay -Dtests.seed=6928E9FF8B52F712 -Dtests.slow=true -Dtests.locale=ckb-IR -Dtests.timezone=Asia/Vientiane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Encountered IncompleteRead exception, pausing and then retrying...
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5568/consoleText
[repro] Revision: 127ce3e360ad88cb0a77a58d81eb09df00c04045
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=OverseerTest -Dtests.method=testReplay -Dtests.seed=6928E9FF8B52F712 -Dtests.slow=true -Dtests.locale=ckb-IR -Dtests.timezone=Asia/Vientiane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Encountered IncompleteRead exception, pausing and then retrying...
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5568/consoleText
[repro] Revision: 127ce3e360ad88cb0a77a58d81eb09df00c04045
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=OverseerTest -Dtests.method=testReplay -Dtests.seed=6928E9FF8B52F712 -Dtests.slow=true -Dtests.locale=ckb-IR -Dtests.timezone=Asia/Vientiane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Encountered IncompleteRead exception, aborting after too many retries.
[...truncated 52 lines...]
raise RuntimeError('ERROR: fetching %s : %s' % (url, e))
RuntimeError: ERROR: fetching https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5568/consoleText : IncompleteRead(0 bytes read)
Build step 'Execute shell' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-11.0.6) - Build #
5567 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5567/
Java: 64bit/jdk-11.0.6 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
Error Message:
Timeout occurred while waiting response from server at: http://127.0.0.1:65055/solr
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: http://127.0.0.1:65055/solr
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at org.apache.solr.cloud.TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper(TestPullReplicaErrorHandling.java:225)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 49 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager: 1) Thread[id=1503, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager] at java.base@11.0.6/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager:
1) Thread[id=1503, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]
at java.base@11.0.6/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([99E902CB2B3543E2]:0)
Build Log:
[...truncated 13317 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager
[junit4] 2> 166715 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/data-dir-8-001
[junit4] 2> 166719 WARN (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 166719 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 166724 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 166725 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 166726 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001
[junit4] 2> 166726 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 166727 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 166727 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 166829 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:65092
[junit4] 2> 166830 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:65092
[junit4] 2> 166830 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:65092
[junit4] 2> 166830 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 65092
[junit4] 2> 166849 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 166856 INFO (zkConnectionManagerCallback-580-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 166859 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 166905 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 166910 INFO (zkConnectionManagerCallback-582-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 166910 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 166915 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 166919 INFO (zkConnectionManagerCallback-584-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 166920 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167041 WARN (jetty-launcher-585-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 167041 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 167041 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 167041 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 167053 WARN (jetty-launcher-585-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 167054 WARN (jetty-launcher-585-thread-3) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 167054 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.6+10
[junit4] 2> 167065 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 167065 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 167065 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 167066 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 167066 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 167066 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 167066 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@140472b5{/solr,null,AVAILABLE}
[junit4] 2> 167067 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@76f777ee{/solr,null,AVAILABLE}
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4e7252{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:65103}
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-2) [ ] o.e.j.s.Server Started @167137ms
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@650eb006{/solr,null,AVAILABLE}
[junit4] 2> 167068 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=65103}
[junit4] 2> 167069 ERROR (jetty-launcher-585-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 167069 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-25T04:40:26.905497Z
[junit4] 2> 167070 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@355e9dfd{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:65104}
[junit4] 2> 167070 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@18c7f96f{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:65105}
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.e.j.s.Server Started @167139ms
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.e.j.s.Server Started @167139ms
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=65105}
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=65104}
[junit4] 2> 167071 ERROR (jetty-launcher-585-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 167071 ERROR (jetty-launcher-585-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-25T04:40:26.907594Z
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 167071 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-01-25T04:40:26.907657Z
[junit4] 2> 167072 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167073 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167074 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167087 INFO (zkConnectionManagerCallback-587-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167087 INFO (zkConnectionManagerCallback-591-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167087 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167088 INFO (zkConnectionManagerCallback-590-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167094 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167097 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167100 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 167101 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 167103 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 167471 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 167492 WARN (jetty-launcher-585-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@17038a13[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167493 WARN (jetty-launcher-585-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@17038a13[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167542 WARN (jetty-launcher-585-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@24fb1849[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167542 WARN (jetty-launcher-585-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@24fb1849[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167543 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:65092/solr
[junit4] 2> 167570 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167579 INFO (zkConnectionManagerCallback-600-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167581 INFO (jetty-launcher-585-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167719 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 167721 WARN (jetty-launcher-585-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5f903b8c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167722 WARN (jetty-launcher-585-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5f903b8c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167764 WARN (jetty-launcher-585-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61a73539[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167764 WARN (jetty-launcher-585-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61a73539[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167765 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:65092/solr
[junit4] 2> 167778 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167792 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167797 INFO (zkConnectionManagerCallback-608-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167797 INFO (jetty-launcher-585-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167798 INFO (zkConnectionManagerCallback-604-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167811 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 167945 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 167955 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 167969 WARN (jetty-launcher-585-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4482fec2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167969 WARN (jetty-launcher-585-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4482fec2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 167978 INFO (zkConnectionManagerCallback-610-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 167978 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 168016 WARN (jetty-launcher-585-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1f7fdba7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 168017 WARN (jetty-launcher-585-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1f7fdba7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 168028 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:65092/solr
[junit4] 2> 168043 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 168054 INFO (zkConnectionManagerCallback-620-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 168054 INFO (jetty-launcher-585-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 168176 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 168185 INFO (zkConnectionManagerCallback-622-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 168186 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170830 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65105_solr
[junit4] 2> 170849 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.Overseer Overseer (id=72064642816016393-127.0.0.1:65105_solr-n_0000000000) starting
[junit4] 2> 171073 INFO (OverseerStateUpdate-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65105_solr
[junit4] 2> 171083 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65105_solr
[junit4] 2> 171164 INFO (zkCallback-609-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 171215 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 171216 WARN (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 171280 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 171362 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65105.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 171380 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65105.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 171380 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65105.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 171382 INFO (jetty-launcher-585-thread-1) [n:127.0.0.1:65105_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node1/.
[junit4] 2> 171738 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 171786 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 171836 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:65104_solr as DOWN
[junit4] 2> 171867 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 171867 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65104_solr
[junit4] 2> 171894 INFO (zkCallback-609-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 171902 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 171915 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 171925 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:65103_solr as DOWN
[junit4] 2> 171939 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 171940 WARN (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 171954 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 171954 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65103_solr
[junit4] 2> 171988 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 171995 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 171999 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 172004 INFO (zkCallback-609-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 172053 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 172054 WARN (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 172101 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65104.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172133 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 172307 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65104.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172308 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65104.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172309 INFO (jetty-launcher-585-thread-3) [n:127.0.0.1:65104_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node3/.
[junit4] 2> 172325 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65103.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172436 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65103.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172440 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65103.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 172496 INFO (jetty-launcher-585-thread-2) [n:127.0.0.1:65103_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node2/.
[junit4] 2> 172646 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
[junit4] 2> 172648 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 172655 INFO (zkConnectionManagerCallback-635-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 172655 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 172661 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 172665 INFO (SUITE-TestSnapshotCloudManager-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:65092/solr ready
[junit4] 2> 172680 INFO (qtp243895795-1551) [n:127.0.0.1:65103_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 172716 INFO (OverseerThreadFactory-297-thread-1-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
[junit4] 2> 172903 INFO (OverseerStateUpdate-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65103/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 172929 INFO (OverseerStateUpdate-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65105/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 172975 INFO (OverseerStateUpdate-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_p4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65104/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 173185 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr x:.system_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 173186 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr x:.system_shard1_replica_p4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 173186 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr x:.system_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 173186 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr x:.system_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 175113 WARN (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrConfig You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
[junit4] 2> 175113 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 175113 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 175114 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 175207 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 175207 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 175207 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 175219 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
[junit4] 2> 175225 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 175233 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 175276 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 175284 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 175284 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 175286 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 175299 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from configset .system, trusted=true
[junit4] 2> 175304 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65103.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 175305 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
[junit4] 2> 175318 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 175322 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 175345 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from configset .system, trusted=true
[junit4] 2> 175346 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65105.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 175346 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node1/.system_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node1/./.system_shard1_replica_n2/data/]
[junit4] 2> 175374 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 175378 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_p4' using configuration from configset .system, trusted=true
[junit4] 2> 175389 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_65104.solr.core..system.shard1.replica_p4' (registry 'solr.core..system.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56e17acf
[junit4] 2> 175390 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrCore [[.system_shard1_replica_p4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node3/.system_shard1_replica_p4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_99E902CB2B3543E2-001/tempDir-001/node3/./.system_shard1_replica_p4/data/]
[junit4] 2> 175648 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 175648 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 175658 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 175658 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 175659 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 175659 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 175663 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 175665 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 175665 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@39fdc860[.system_shard1_replica_n1] main]
[junit4] 2> 175690 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@419fa4b4[.system_shard1_replica_n2] main]
[junit4] 2> 175692 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 175696 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 175715 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 175719 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 175726 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 175728 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 175739 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 175747 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 175747 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 175748 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 175748 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1656673780979728384
[junit4] 2> 175775 INFO (searcherExecutor-310-thread-1-processing-n:127.0.0.1:65103_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@39fdc860[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 175810 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 175813 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 70 ms
[junit4] 2> 175814 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 175815 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1656673781049982976
[junit4] 2> 175843 INFO (searcherExecutor-311-thread-1-processing-n:127.0.0.1:65105_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node5) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@419fa4b4[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 175854 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 175854 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 175865 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6964e81c[.system_shard1_replica_p4] main]
[junit4] 2> 175866 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 175866 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 175887 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 175888 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 175889 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 175897 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 175897 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 175916 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 175921 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
[junit4] 2> 175992 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 175993 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 74 ms
[junit4] 2> 175993 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 176024 INFO (searcherExecutor-312-thread-1-processing-n:127.0.0.1:65104_solr x:.system_shard1_replica_p4 c:.system s:shard1 r:core_node6) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@6964e81c[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 176045 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 176053 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 176053 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:65103/solr/.system_shard1_replica_n1/
[junit4] 2> 176070 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=http://127.0.0.1:65103/solr START replicas=[http://127.0.0.1:65105/solr/.system_shard1_replica_n2/] nUpdates=100
[junit4] 2> 176079 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=http://127.0.0.1:65103/solr DONE. We have no versions. sync failed.
[junit4] 2> 176082 INFO (qtp369104351-1550) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 176084 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 176084 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 176084 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/.system/leaders/shard1/leader after winning as /collections/.system/leader_elect/shard1/election/72064642816016395-core_node3-n_0000000000
[junit4] 2> 176098 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.ZkController .system_shard1_replica_p4 starting background replication from leader
[junit4] 2> 176099 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
[junit4] 2> 176102 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 176102 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 176139 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:65103/solr/.system_shard1_replica_n1/ shard1
[junit4] 2> 176289 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 176292 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 176299 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 176315 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 176346 INFO (qtp999908606-1545) [n:127.0.0.1:65104_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=3160
[junit4] 2> 176357 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3171
[junit4] 2> 176468 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 176469 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 176470 INFO (zkCallback-621-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 176470 INFO (zkCallback-603-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177037 INFO (qtp369104351-1541) [n:127.0.0.1:65105_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3851
[junit4] 2> 177046 INFO (qtp243895795-1551) [n:127.0.0.1:65103_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 177105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
[junit4] 2> 177105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:65103/solr/.system_shard1_replica_n1/
[junit4] 2> 177109 INFO (qtp243895795-1553) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 177110 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 177110 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 177110 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 177110 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 177110 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 177112 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 177112 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5cace5cd commitCommandVersion:0
[junit4] 2> 177116 INFO (indexFetcher-325-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@54cbe534[.system_shard1_replica_p4] main]
[junit4] 2> 177117 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 177123 INFO (searcherExecutor-312-thread-1) [ ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@54cbe534[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 177143 INFO (zkCallback-603-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177144 INFO (zkCallback-609-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177144 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177144 INFO (zkCallback-621-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177144 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177145 INFO (zkCallback-609-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 177151 INFO (qtp243895795-1551) [n:127.0.0.1:65103_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=4471
[junit4] 2> 177153 INFO (qtp243895795-1554) [n:127.0.0.1:65103_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params name=coll1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 177182 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection coll1
[junit4] 2> 177187 INFO (OverseerCollectionConfigSetProcessor-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 177195 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/coll1.AUTOCREATED/managed-schema
[junit4] 2> 177236 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/coll1.AUTOCREATED/protwords.txt
[junit4] 2> 177281 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/coll1.AUTOCREATED/lang/contractions_it.txt
[junit4] 2> 177334 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/coll1.AUTOCREATED/lang/contractions_ca.txt
[junit4] 2> 177403 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/coll1.AUTOCREATED/lang/stemdict_nl.txt
[junit4] 2> 177470 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/coll1.AUTOCREATED/lang/stopwords_no.txt
[junit4] 2> 177545 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hy.txt
[junit4] 2> 177590 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/coll1.AUTOCREATED/lang/stopwords_id.txt
[junit4] 2> 177668 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_et.txt to /configs/coll1.AUTOCREATED/lang/stopwords_et.txt
[junit4] 2> 177736 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/coll1.AUTOCREATED/lang/stopwords_da.txt
[junit4] 2> 177796 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hi.txt
[junit4] 2> 177859 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ga.txt
[junit4] 2> 177921 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/coll1.AUTOCREATED/lang/stopwords_pt.txt
[junit4] 2> 177948 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ja.txt
[junit4] 2> 177991 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hu.txt
[junit4] 2> 178072 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/coll1.AUTOCREATED/lang/stopwords_el.txt
[junit4] 2> 178104 INFO (qtp243895795-1548) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 2
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1579927236948
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 178105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5cace5cd commitCommandVersion:0
[junit4] 2> 178114 INFO (indexFetcher-325-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@29e05485[.system_shard1_replica_p4] main]
[junit4] 2> 178115 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 178116 INFO (searcherExecutor-312-thread-1) [ ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@29e05485[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 178132 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ru.txt
[junit4] 2> 178201 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/coll1.AUTOCREATED/lang/stopwords_tr.txt
[junit4] 2> 178238 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ar.txt
[junit4] 2> 178314 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/coll1.AUTOCREATED/lang/userdict_ja.txt
[junit4] 2> 178388 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/coll1.AUTOCREATED/lang/stopwords_eu.txt
[junit4] 2> 178457 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/coll1.AUTOCREATED/lang/stopwords_it.txt
[junit4] 2> 178492 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/coll1.AUTOCREATED/lang/stopwords_cz.txt
[junit4] 2> 178524 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/coll1.AUTOCREATED/lang/stoptags_ja.txt
[junit4] 2> 178552 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/coll1.AUTOCREATED/lang/contractions_fr.txt
[junit4] 2> 178606 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/coll1.AUTOCREATED/lang/stopwords_de.txt
[junit4] 2> 178647 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fa.txt
[junit4] 2> 178683 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/coll1.AUTOCREATED/lang/contractions_ga.txt
[junit4] 2> 178730 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ca.txt
[junit4] 2> 178773 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/coll1.AUTOCREATED/lang/stopwords_nl.txt
[junit4] 2> 178801 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/coll1.AUTOCREATED/lang/stopwords_bg.txt
[junit4] 2> 178844 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/coll1.AUTOCREATED/lang/stopwords_es.txt
[junit4] 2> 178882 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/coll1.AUTOCREATED/lang/stopwords_lv.txt
[junit4] 2> 178901 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/coll1.AUTOCREATED/lang/stopwords_en.txt
[junit4] 2> 178925 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ro.txt
[junit4] 2> 178949 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/coll1.AUTOCREATED/lang/stopwords_th.txt
[junit4] 2> 179004 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fr.txt
[junit4] 2> 179029 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/coll1.AUTOCREATED/lang/stopwords_sv.txt
[junit4] 2> 179064 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fi.txt
[junit4] 2> 179095 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/coll1.AUTOCREATED/lang/hyphenations_ga.txt
[junit4] 2> 179104 INFO (qtp243895795-1553) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 179105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 179105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 179105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 3
[junit4] 2> 179105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1579927237941
[junit4] 2> 179105 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 179106 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 179106 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5cace5cd commitCommandVersion:0
[junit4] 2> 179107 INFO (indexFetcher-325-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@322e8424[.system_shard1_replica_p4] main]
[junit4] 2> 179107 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 179109 INFO (searcherExecutor-312-thread-1) [ ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@322e8424[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 179114 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/coll1.AUTOCREATED/lang/stopwords_gl.txt
[junit4] 2> 179143 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/coll1.AUTOCREATED/solrconfig.xml
[junit4] 2> 179190 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/coll1.AUTOCREATED/synonyms.txt
[junit4] 2> 179266 INFO (OverseerThreadFactory-297-thread-2-processing-n:127.0.0.1:65105_solr) [n:127.0.0.1:65105_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/coll1.AUTOCREATED/stopwords.txt
[junit4] 2> 179637 INFO (OverseerStateUpdate-72064642816016393-127.0.0.1:65105_solr-n_0000000000) [n:127.0.0.1:65105_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"coll1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"coll1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:65103/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 179857 INFO (qtp243895795-1551) [n:127.0.0.1:65103_solr x:coll1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=coll1.AUTOCREATED&newCollection=true&name=coll1_shard1_replica_n1&action=CREATE&numShards=1&collection=coll1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 181838 INFO (qtp243895795-1548) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 4
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1579927238942
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 181838 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5cace5cd commitCommandVersion:0
[junit4] 2> 181841 INFO (indexFetcher-325-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@43fe77b4[.system_shard1_replica_p4] main]
[junit4] 2> 181842 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 181843 INFO (searcherExecutor-312-thread-1) [ ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@43fe77b4[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 181845 INFO (qtp243895795-1553) [n:127.0.0.1:65103_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 181845 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 181845 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 181845 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 5
[junit4] 2> 181845 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 1579927241674
[junit4] 2> 181846 INFO (indexFetcher-325-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 181846 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 181846 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5cace5cd commitCommandVersion:0
[junit4] 2> 181846 INFO (indexFetcher-325-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@288dd424[.system_shard1_replica_p4] main]
[junit4] 2> 181847 INFO (indexFetcher-325-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 181849 INFO (searcherExecutor-312-thread-1) [ ] o.a.s.c.SolrCore [.system_shard1_replica_p4]
[...truncated too long message...]
@58ef2276: rootName = solr_65055, domain = solr.core.pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper.shard1.replica_p2, service url = null, agent id = null] for registry solr.core.pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper.shard1.replica_p2 / com.codahale.metrics.MetricRegistry@216d351e
[junit4] 2> 366367 INFO (coreCloseExecutor-320-thread-1) [n:127.0.0.1:65055_solr c:pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper s:shard1 r:core_node4 x:pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_p2 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper.shard1.leader, tag=SolrCore@41f7cb2b
[junit4] 2> 366368 INFO (coreCloseExecutor-320-thread-1) [n:127.0.0.1:65055_solr c:pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper s:shard1 r:core_node4 x:pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_p2 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 366371 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 366371 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7190191f: rootName = solr_65055, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4ec01864
[junit4] 2> 366376 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 366376 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b187198: rootName = solr_65055, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7f8ee929
[junit4] 2> 366378 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 366378 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@58ba4c23: rootName = solr_65055, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@20deaa12
[junit4] 2> 366378 INFO (jetty-closer-357-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 366380 INFO (closeThreadPool-373-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72064641522335781-127.0.0.1:65055_solr-n_0000000017) closing
[junit4] 2> 366380 INFO (OverseerAutoScalingTriggerThread-72064641522335781-127.0.0.1:65055_solr-n_0000000017) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 366380 INFO (OverseerStateUpdate-72064641522335781-127.0.0.1:65055_solr-n_0000000017) [n:127.0.0.1:65055_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65055_solr
[junit4] 2> 366388 INFO (closeThreadPool-373-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72064641522335781-127.0.0.1:65055_solr-n_0000000017) closing
[junit4] 2> 366498 INFO (jetty-closer-357-thread-3) [ ] o.a.s.c.Overseer Overseer (id=72064641522335781-127.0.0.1:65055_solr-n_0000000017) closing
[junit4] 2> 366972 INFO (jetty-closer-357-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7a716f7c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 366972 INFO (jetty-closer-357-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@79d1658{/solr,null,UNAVAILABLE}
[junit4] 2> 366972 INFO (jetty-closer-357-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 366975 INFO (SUITE-TestPullReplicaErrorHandling-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 367186 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 19 /solr/aliases.json
[junit4] 2> 18 /solr/security.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 8 /solr/packages.json
[junit4] 2> 7 /solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/terms/shard1
[junit4] 2> 7 /solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard1
[junit4] 2> 7 /solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard2
[junit4] 2> 6 /solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
[junit4] 2> 6 /solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/terms/shard1
[junit4] 2> 3 /solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
[junit4] 2> 2 /solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/collectionprops.json
[junit4] 2> 2 /solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 54 /solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
[junit4] 2> 24 /solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
[junit4] 2> 24 /solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
[junit4] 2> 19 /solr/clusterstate.json
[junit4] 2> 15 /solr/clusterprops.json
[junit4] 2> 7 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/72064641522335772-127.0.0.1:65047_solr-n_0000000008
[junit4] 2> 2 /solr/overseer_elect/election/72064641522335754-127.0.0.1:65018_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 106 /solr/overseer/queue
[junit4] 2> 105 /solr/live_nodes
[junit4] 2> 44 /solr/collections
[junit4] 2> 22 /solr/overseer/collection-queue-work
[junit4] 2> 8 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 7 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 7 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 367192 INFO (SUITE-TestPullReplicaErrorHandling-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:65010
[junit4] 2> 367192 INFO (SUITE-TestPullReplicaErrorHandling-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:65010
[junit4] 2> 367192 INFO (SUITE-TestPullReplicaErrorHandling-seed#[99E902CB2B3543E2]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 65010
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_99E902CB2B3543E2-001
[junit4] 2> Jan 25, 2020 4:43:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@67097f46), locale=rwk, timezone=Antarctica/Mawson
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=6,threads=1,free=67517000,total=195100672
[junit4] 2> NOTE: All tests run in this JVM: [MultiDestinationAuditLoggerTest, SolrShardReporterTest, Tagger2Test, TestOmitPositions, TestStandardQParsers, TestCloudJSONFacetJoinDomain, TestPullReplicaErrorHandling]
[junit4] Completed [93/900 (2!)] on J2 in 221.12s, 3 tests, 1 error <<< FAILURES!
[...truncated 55283 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5567/consoleText
[repro] Revision: 74e88deba78ea40f81c3072d6e014903773f4e92
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=TestSnapshotCloudManager -Dtests.seed=99E902CB2B3543E2 -Dtests.slow=true -Dtests.locale=am-ET -Dtests.timezone=America/Edmonton -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=TestPullReplicaErrorHandling -Dtests.method=testPullReplicaDisconnectsFromZooKeeper -Dtests.seed=99E902CB2B3543E2 -Dtests.slow=true -Dtests.locale=rwk -Dtests.timezone=Antarctica/Mawson -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestPullReplicaErrorHandling
[repro] TestSnapshotCloudManager
[repro] ant compile-test
[...truncated 3408 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestPullReplicaErrorHandling|*.TestSnapshotCloudManager" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=99E902CB2B3543E2 -Dtests.slow=true -Dtests.locale=rwk -Dtests.timezone=Antarctica/Mawson -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 131 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.TestPullReplicaErrorHandling
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager
[repro] Exiting with code 0
[...truncated 73 lines...]