You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/12/24 22:03:57 UTC
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build #
21135 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21135/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
Error Message:
Error from server at http://127.0.0.1:35203/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35203/solr: create the collection time out:180s
at __randomizedtesting.SeedInfo.seed([235896DC4D7C8365:F25F6459E9730857]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.LegacyCloudClusterPropTest.createAndTest(LegacyCloudClusterPropTest.java:86)
at org.apache.solr.cloud.LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud(LegacyCloudClusterPropTest.java:70)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
Error Message:
Timed out waiting for leader elections null Live Nodes: [127.0.0.1:36593_solr, 127.0.0.1:46055_solr] Last available state: DocCollection(halfdeletedcollection2//collections/halfdeletedcollection2/state.json/9)={ "pullReplicas":"0", "replicationFactor":"3", "shards":{ "shard1":{ "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node3":{ "core":"halfdeletedcollection2_shard1_replica_n1", "base_url":"http://127.0.0.1:35347/solr", "node_name":"127.0.0.1:35347_solr", "state":"down", "type":"NRT"}, "core_node5":{ "core":"halfdeletedcollection2_shard1_replica_n2", "base_url":"http://127.0.0.1:36593/solr", "node_name":"127.0.0.1:36593_solr", "state":"active", "type":"NRT"}, "core_node7":{ "core":"halfdeletedcollection2_shard1_replica_n4", "base_url":"http://127.0.0.1:37761/solr", "node_name":"127.0.0.1:37761_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node9":{ "core":"halfdeletedcollection2_shard2_replica_n6", "base_url":"http://127.0.0.1:46055/solr", "node_name":"127.0.0.1:46055_solr", "state":"active", "type":"NRT"}, "core_node11":{ "core":"halfdeletedcollection2_shard2_replica_n8", "base_url":"http://127.0.0.1:35347/solr", "node_name":"127.0.0.1:35347_solr", "state":"down", "type":"NRT"}, "core_node13":{ "core":"halfdeletedcollection2_shard2_replica_n10", "base_url":"http://127.0.0.1:36593/solr", "node_name":"127.0.0.1:36593_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard3":{ "range":"0-3fffffff", "state":"active", "replicas":{ "core_node15":{ "core":"halfdeletedcollection2_shard3_replica_n12", "base_url":"http://127.0.0.1:37761/solr", "node_name":"127.0.0.1:37761_solr", "state":"down", "type":"NRT"}, "core_node17":{ "core":"halfdeletedcollection2_shard3_replica_n14", "base_url":"http://127.0.0.1:46055/solr", "node_name":"127.0.0.1:46055_solr", "state":"active", "type":"NRT"}, "core_node19":{ "core":"halfdeletedcollection2_shard3_replica_n16", "base_url":"http://127.0.0.1:35347/solr", "node_name":"127.0.0.1:35347_solr", "state":"down", "type":"NRT"}}}, "shard4":{ "range":"40000000-7fffffff", "state":"active", "replicas":{ "core_node21":{ "core":"halfdeletedcollection2_shard4_replica_n18", "base_url":"http://127.0.0.1:36593/solr", "node_name":"127.0.0.1:36593_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node23":{ "core":"halfdeletedcollection2_shard4_replica_n20", "base_url":"http://127.0.0.1:37761/solr", "node_name":"127.0.0.1:37761_solr", "state":"down", "type":"NRT"}, "core_node24":{ "core":"halfdeletedcollection2_shard4_replica_n22", "base_url":"http://127.0.0.1:46055/solr", "node_name":"127.0.0.1:46055_solr", "state":"active", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"3", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timed out waiting for leader elections
null
Live Nodes: [127.0.0.1:36593_solr, 127.0.0.1:46055_solr]
Last available state: DocCollection(halfdeletedcollection2//collections/halfdeletedcollection2/state.json/9)={
"pullReplicas":"0",
"replicationFactor":"3",
"shards":{
"shard1":{
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"halfdeletedcollection2_shard1_replica_n1",
"base_url":"http://127.0.0.1:35347/solr",
"node_name":"127.0.0.1:35347_solr",
"state":"down",
"type":"NRT"},
"core_node5":{
"core":"halfdeletedcollection2_shard1_replica_n2",
"base_url":"http://127.0.0.1:36593/solr",
"node_name":"127.0.0.1:36593_solr",
"state":"active",
"type":"NRT"},
"core_node7":{
"core":"halfdeletedcollection2_shard1_replica_n4",
"base_url":"http://127.0.0.1:37761/solr",
"node_name":"127.0.0.1:37761_solr",
"state":"down",
"type":"NRT"}}},
"shard2":{
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node9":{
"core":"halfdeletedcollection2_shard2_replica_n6",
"base_url":"http://127.0.0.1:46055/solr",
"node_name":"127.0.0.1:46055_solr",
"state":"active",
"type":"NRT"},
"core_node11":{
"core":"halfdeletedcollection2_shard2_replica_n8",
"base_url":"http://127.0.0.1:35347/solr",
"node_name":"127.0.0.1:35347_solr",
"state":"down",
"type":"NRT"},
"core_node13":{
"core":"halfdeletedcollection2_shard2_replica_n10",
"base_url":"http://127.0.0.1:36593/solr",
"node_name":"127.0.0.1:36593_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard3":{
"range":"0-3fffffff",
"state":"active",
"replicas":{
"core_node15":{
"core":"halfdeletedcollection2_shard3_replica_n12",
"base_url":"http://127.0.0.1:37761/solr",
"node_name":"127.0.0.1:37761_solr",
"state":"down",
"type":"NRT"},
"core_node17":{
"core":"halfdeletedcollection2_shard3_replica_n14",
"base_url":"http://127.0.0.1:46055/solr",
"node_name":"127.0.0.1:46055_solr",
"state":"active",
"type":"NRT"},
"core_node19":{
"core":"halfdeletedcollection2_shard3_replica_n16",
"base_url":"http://127.0.0.1:35347/solr",
"node_name":"127.0.0.1:35347_solr",
"state":"down",
"type":"NRT"}}},
"shard4":{
"range":"40000000-7fffffff",
"state":"active",
"replicas":{
"core_node21":{
"core":"halfdeletedcollection2_shard4_replica_n18",
"base_url":"http://127.0.0.1:36593/solr",
"node_name":"127.0.0.1:36593_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node23":{
"core":"halfdeletedcollection2_shard4_replica_n20",
"base_url":"http://127.0.0.1:37761/solr",
"node_name":"127.0.0.1:37761_solr",
"state":"down",
"type":"NRT"},
"core_node24":{
"core":"halfdeletedcollection2_shard4_replica_n22",
"base_url":"http://127.0.0.1:46055/solr",
"node_name":"127.0.0.1:46055_solr",
"state":"active",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"3",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([235896DC4D7C8365:BD6DF2246B5FCFED]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes(TestDeleteCollectionOnDownNodes.java:47)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11931 lines...]
[junit4] Suite: org.apache.solr.cloud.LegacyCloudClusterPropTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/init-core-data-001
[junit4] 2> 90893 WARN (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
[junit4] 2> 90893 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 90894 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 90894 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 90894 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001
[junit4] 2> 90894 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 90894 INFO (Thread-343) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 90894 INFO (Thread-343) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 90896 ERROR (Thread-343) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 90994 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34429
[junit4] 2> 90996 INFO (zkConnectionManagerCallback-497-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 90999 INFO (jetty-launcher-494-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 90999 INFO (jetty-launcher-494-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27be1991{/solr,null,AVAILABLE}
[junit4] 2> 91003 INFO (jetty-launcher-494-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@83912f3{HTTP/1.1,[http/1.1]}{127.0.0.1:35203}
[junit4] 2> 91003 INFO (jetty-launcher-494-thread-1) [ ] o.e.j.s.Server Started @92586ms
[junit4] 2> 91003 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35203}
[junit4] 2> 91003 ERROR (jetty-launcher-494-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 91004 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 91004 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 91004 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 91004 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-24T20:55:56.258Z
[junit4] 2> 91005 INFO (zkConnectionManagerCallback-499-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 91006 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 91012 INFO (jetty-launcher-494-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34429/solr
[junit4] 2> 91013 INFO (zkConnectionManagerCallback-503-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 91014 INFO (zkConnectionManagerCallback-505-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 91038 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 91038 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35203_solr
[junit4] 2> 91038 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer (id=99231265990180867-127.0.0.1:35203_solr-n_0000000000) starting
[junit4] 2> 91042 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35203_solr
[junit4] 2> 91046 INFO (zkCallback-504-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 91190 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 91199 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 91199 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 91200 INFO (jetty-launcher-494-thread-1) [n:127.0.0.1:35203_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/.
[junit4] 2> 91225 INFO (zkConnectionManagerCallback-509-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 91238 INFO (zkConnectionManagerCallback-513-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 91239 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 91239 INFO (SUITE-LegacyCloudClusterPropTest-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34429/solr ready
[junit4] 2> 91250 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateCollectionSwitchLegacyCloud
[junit4] 2> 91299 INFO (qtp213672984-1997) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=true&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 91300 INFO (qtp213672984-1997) [n:127.0.0.1:35203_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=true&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 91304 INFO (qtp213672984-1998) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=legacyTrue&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 91305 INFO (OverseerThreadFactory-899-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.CreateCollectionCmd Create collection legacyTrue
[junit4] 2> 91410 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&name=legacyTrue_shard1_replica_n1&action=CREATE&numShards=1&collection=legacyTrue&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 91410 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 91512 INFO (zkCallback-504-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyTrue/state.json] for collection [legacyTrue] has occurred - updating... (live nodes size: [1])
[junit4] 2> 92424 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 92443 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.IndexSchema [legacyTrue_shard1_replica_n1] Schema name=minimal
[junit4] 2> 92444 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 92444 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'legacyTrue_shard1_replica_n1' using configuration from collection legacyTrue, trusted=true
[junit4] 2> 92445 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.core.legacyTrue.shard1.replica_n1' (registry 'solr.core.legacyTrue.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 92445 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 92445 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [[legacyTrue_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/legacyTrue_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/./legacyTrue_shard1_replica_n1/data/]
[junit4] 2> 92471 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 92471 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 92472 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 92472 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 92473 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@35b0b6ca[legacyTrue_shard1_replica_n1] main]
[junit4] 2> 92474 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 92474 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 92474 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 92475 INFO (searcherExecutor-902-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [legacyTrue_shard1_replica_n1] Registered new searcher Searcher@35b0b6ca[legacyTrue_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 92475 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587700257499643904
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/ has no replicas
[junit4] 2> 92478 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 92479 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/ shard1
[junit4] 2> 92580 INFO (zkCallback-504-thread-2-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyTrue/state.json] for collection [legacyTrue] has occurred - updating... (live nodes size: [1])
[junit4] 2> 92629 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 92639 INFO (qtp213672984-1992) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=legacyTrue_shard1_replica_n1&action=CREATE&numShards=1&collection=legacyTrue&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1229
[junit4] 2> 92642 INFO (qtp213672984-1998) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 92731 INFO (zkCallback-504-thread-2-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyTrue/state.json] for collection [legacyTrue] has occurred - updating... (live nodes size: [1])
[junit4] 2> 93306 INFO (OverseerCollectionConfigSetProcessor-99231265990180867-127.0.0.1:35203_solr-n_0000000000) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 93642 INFO (qtp213672984-1998) [n:127.0.0.1:35203_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=legacyTrue&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2338
[junit4] 2> 93653 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@83912f3{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 93653 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=301740398
[junit4] 2> 93653 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 93653 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d5635e3: rootName = solr_35203, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ce73484
[junit4] 2> 93659 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 93659 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4f18af7f: rootName = solr_35203, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1772d66b
[junit4] 2> 93663 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 93663 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ff7e944: rootName = solr_35203, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@134d405d
[junit4] 2> 93664 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35203_solr
[junit4] 2> 93665 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 93665 INFO (zkCallback-504-thread-2-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 93665 INFO (zkCallback-512-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 93665 INFO (coreCloseExecutor-907-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [legacyTrue_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@708fa487
[junit4] 2> 93665 INFO (coreCloseExecutor-907-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.legacyTrue.shard1.replica_n1, tag=1888461959
[junit4] 2> 93665 INFO (coreCloseExecutor-907-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@70fe1f82: rootName = solr_35203, domain = solr.core.legacyTrue.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.legacyTrue.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@b76be7e
[junit4] 2> 93670 INFO (coreCloseExecutor-907-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.legacyTrue.shard1.leader, tag=1888461959
[junit4] 2> 93672 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.c.Overseer Overseer (id=99231265990180867-127.0.0.1:35203_solr-n_0000000000) closing
[junit4] 2> 93672 INFO (OverseerStateUpdate-99231265990180867-127.0.0.1:35203_solr-n_0000000000) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35203_solr
[junit4] 2> 93672 WARN (OverseerAutoScalingTriggerThread-99231265990180867-127.0.0.1:35203_solr-n_0000000000) [n:127.0.0.1:35203_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 93673 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@27be1991{/solr,null,UNAVAILABLE}
[junit4] 2> 93673 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 93674 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43fb7521{/solr,null,AVAILABLE}
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@37ec07a7{HTTP/1.1,[http/1.1]}{127.0.0.1:35203}
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.e.j.s.Server Started @95258ms
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35203}
[junit4] 2> 93675 ERROR (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 93675 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-24T20:55:58.929Z
[junit4] 2> 93676 INFO (zkConnectionManagerCallback-515-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93677 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93684 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34429/solr
[junit4] 2> 93685 INFO (zkConnectionManagerCallback-519-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93687 INFO (zkConnectionManagerCallback-521-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93690 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 93690 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35203_solr
[junit4] 2> 93691 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer (id=99231265990180872-127.0.0.1:35203_solr-n_0000000001) starting
[junit4] 2> 93697 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35203_solr
[junit4] 2> 93698 INFO (zkCallback-512-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 93702 INFO (zkCallback-520-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 93746 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 93751 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 93751 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 93752 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/.
[junit4] 2> 93752 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [n:127.0.0.1:35203_solr ] o.a.s.c.CorePropertiesLocator Cores are: [legacyTrue_shard1_replica_n1]
[junit4] 2> 93753 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 93758 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 93762 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.s.IndexSchema [legacyTrue_shard1_replica_n1] Schema name=minimal
[junit4] 2> 93763 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 93768 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 93772 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.IndexSchema [legacyTrue_shard1_replica_n1] Schema name=minimal
[junit4] 2> 93774 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 93774 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'legacyTrue_shard1_replica_n1' using configuration from collection legacyTrue, trusted=true
[junit4] 2> 93774 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.core.legacyTrue.shard1.replica_n1' (registry 'solr.core.legacyTrue.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 93774 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 93774 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [[legacyTrue_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/legacyTrue_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/./legacyTrue_shard1_replica_n1/data/]
[junit4] 2> 93797 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 93797 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 93799 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 93799 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 93799 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c0b2886[legacyTrue_shard1_replica_n1] main]
[junit4] 2> 93800 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 93800 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 93800 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 93801 INFO (searcherExecutor-919-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [legacyTrue_shard1_replica_n1] Registered new searcher Searcher@3c0b2886[legacyTrue_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 93801 INFO (coreLoadExecutor-918-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 x:legacyTrue_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587700258890055680
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/ has no replicas
[junit4] 2> 93803 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 93804 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35203/solr/legacyTrue_shard1_replica_n1/ shard1
[junit4] 2> 93804 INFO (coreZkRegister-909-thread-1-processing-n:127.0.0.1:35203_solr x:legacyTrue_shard1_replica_n1 s:shard1 c:legacyTrue) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 93905 INFO (zkCallback-520-thread-2-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyTrue/state.json] for collection [legacyTrue] has occurred - updating... (live nodes size: [1])
[junit4] 2> 94805 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.h.i.e.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://127.0.0.1:35203: The target server failed to respond
[junit4] 2> 94805 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.h.i.e.RetryExec Retrying request to {}->http://127.0.0.1:35203
[junit4] 2> 94807 INFO (qtp486873068-2047) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 94807 INFO (qtp486873068-2047) [n:127.0.0.1:35203_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 94808 INFO (qtp486873068-2048) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=legacyFalse&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 94809 INFO (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.CreateCollectionCmd Create collection legacyFalse
[junit4] 2> 95013 INFO (OverseerStateUpdate-99231265990180872-127.0.0.1:35203_solr-n_0000000001) [n:127.0.0.1:35203_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"legacyFalse",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"legacyFalse_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35203/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 95215 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=legacyFalse_shard1_replica_n1&action=CREATE&numShards=1&collection=legacyFalse&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 95317 INFO (zkCallback-520-thread-2-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyFalse/state.json] for collection [legacyFalse] has occurred - updating... (live nodes size: [1])
[junit4] 2> 95317 INFO (zkCallback-520-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/legacyFalse/state.json] for collection [legacyFalse] has occurred - updating... (live nodes size: [1])
[junit4] 2> 96227 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 96297 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.s.IndexSchema [legacyFalse_shard1_replica_n1] Schema name=minimal
[junit4] 2> 96299 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 96299 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'legacyFalse_shard1_replica_n1' using configuration from collection legacyFalse, trusted=true
[junit4] 2> 96299 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35203.solr.core.legacyFalse.shard1.replica_n1' (registry 'solr.core.legacyFalse.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7554fd58
[junit4] 2> 96299 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 96299 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SolrCore [[legacyFalse_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/legacyFalse_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LegacyCloudClusterPropTest_235896DC4D7C8365-001/tempDir-001/node1/./legacyFalse_shard1_replica_n1/data/]
[junit4] 2> 96339 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 96339 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 96340 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 96340 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 96341 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6bd057a4[legacyFalse_shard1_replica_n1] main]
[junit4] 2> 96342 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 96342 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 96342 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 96343 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587700261555535872
[junit4] 2> 96352 INFO (searcherExecutor-924-thread-1-processing-n:127.0.0.1:35203_solr x:legacyFalse_shard1_replica_n1 s:shard1 c:legacyFalse r:core_node2) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SolrCore [legacyFalse_shard1_replica_n1] Registered new searcher Searcher@6bd057a4[legacyFalse_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35203/solr/legacyFalse_shard1_replica_n1/
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35203/solr/legacyFalse_shard1_replica_n1/ has no replicas
[junit4] 2> 96354 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 96355 INFO (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35203/solr/legacyFalse_shard1_replica_n1/ shard1
[junit4] 2> 274814 ERROR (qtp486873068-2048) [n:127.0.0.1:35203_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 274815 INFO (qtp486873068-2048) [n:127.0.0.1:35203_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=legacyFalse&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=180006
[junit4] 2> 274816 ERROR (qtp486873068-2048) [n:127.0.0.1:35203_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 274817 INFO (TEST-LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud-seed#[235896DC4D7C8365]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateCollectionSwitchLegacyCloud
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LegacyCloudClusterPropTest -Dtests.method=testCreateCollectionSwitchLegacyCloud -Dtests.seed=235896DC4D7C8365 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-Latn -Dtests.timezone=America/Marigot -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 184s J2 | LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35203/solr: create the collection time out:180s
[junit4] > at __randomizedtesting.SeedInfo.seed([235896DC4D7C8365:F25F6459E9730857]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.LegacyCloudClusterPropTest.createAndTest(LegacyCloudClusterPropTest.java:86)
[junit4] > at org.apache.solr.cloud.LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud(LegacyCloudClusterPropTest.java:70)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 274822 INFO (jetty-closer-495-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@37ec07a7{HTTP/1.1,[http/1.1]}{127.0.0.1:35203}
[junit4] 2> 274822 INFO (jetty-closer-495-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=740654551
[junit4] 2> 274822 ERROR (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:35203/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:35203/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:35203 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 274822 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 274824 ERROR (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [legacyFalse].
[junit4] 2> 274824 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15d8362c: rootName = solr_35203, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6bf99be2
[junit4] 2> 274824 INFO (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 274825 ERROR (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:35203/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:35203/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:35203 [/127.0.0.1] failed: Connection refused (Connection refused)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
[junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
[junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
[junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] 2> at java.net.Socket.connect(Socket.java:589)
[junit4] 2> at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
[junit4] 2> ... 22 more
[junit4] 2> 274830 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 274830 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c892fa9: rootName = solr_35203, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1772d66b
[junit4] 2> 274834 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 274834 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6dbc44a4: rootName = solr_35203, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@134d405d
[junit4] 2> 274835 INFO (jetty-closer-495-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35203_solr
[junit4] 2> 274835 INFO (jetty-closer-495-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 274836 INFO (zkCallback-520-thread-5-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 274836 INFO (coreCloseExecutor-929-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.c.SolrCore [legacyTrue_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@71a7033e
[junit4] 2> 274836 INFO (coreCloseExecutor-929-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.legacyTrue.shard1.replica_n1, tag=1906770750
[junit4] 2> 274836 INFO (coreCloseExecutor-929-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c8fd747: rootName = solr_35203, domain = solr.core.legacyTrue.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.legacyTrue.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@69caf2f7
[junit4] 2> 274837 INFO (coreCloseExecutor-929-thread-2) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.SolrCore [legacyFalse_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@253ac2a0
[junit4] 2> 274844 INFO (coreCloseExecutor-929-thread-2) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.legacyFalse.shard1.replica_n1, tag=624607904
[junit4] 2> 274844 INFO (coreCloseExecutor-929-thread-2) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5c675f8e: rootName = solr_35203, domain = solr.core.legacyFalse.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.legacyFalse.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@5d5f606a
[junit4] 2> 274852 INFO (coreCloseExecutor-929-thread-1) [n:127.0.0.1:35203_solr c:legacyTrue s:shard1 r:core_node2 x:legacyTrue_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.legacyTrue.shard1.leader, tag=1906770750
[junit4] 2> 274853 INFO (coreCloseExecutor-929-thread-2) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.legacyFalse.shard1.leader, tag=624607904
[junit4] 2> 274857 INFO (jetty-closer-495-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99231265990180872-127.0.0.1:35203_solr-n_0000000001) closing
[junit4] 2> 274857 INFO (OverseerStateUpdate-99231265990180872-127.0.0.1:35203_solr-n_0000000001) [n:127.0.0.1:35203_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35203_solr
[junit4] 2> 304879 INFO (zkCallback-520-thread-5-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/legacyFalse/state.json] for collection [legacyFalse] has occurred - updating... (live nodes size: [0])
[junit4] 2> 304879 INFO (zkCallback-520-thread-4-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/legacyFalse/state.json] for collection [legacyFalse] has occurred - updating... (live nodes size: [0])
[junit4] 2> 304880 ERROR (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: legacyFalse operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: legacyFalse
[junit4] 2> at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:112)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:688)
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:240)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:242)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 304889 INFO (OverseerThreadFactory-916-thread-1-processing-n:127.0.0.1:35203_solr) [n:127.0.0.1:35203_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 304889 WARN (OverseerAutoScalingTriggerThread-99231265990180872-127.0.0.1:35203_solr-n_0000000001) [n:127.0.0.1:35203_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 304894 INFO (jetty-closer-495-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@43fb7521{/solr,null,UNAVAILABLE}
[junit4] 2> 304912 ERROR (qtp486873068-2042) [n:127.0.0.1:35203_solr c:legacyFalse s:shard1 r:core_node2 x:legacyFalse_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
[junit4] 2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: legacyFalse slice: shard1 saw state=null with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:892)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1053)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:954)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177
[...truncated too long message...]
1440988 INFO (coreCloseExecutor-2828-thread-3) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfdeletedcollection2.shard4.replica_n22, tag=1002311413
[junit4] 2> 1440988 INFO (coreCloseExecutor-2828-thread-3) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4624ab14: rootName = solr_46055, domain = solr.core.halfdeletedcollection2.shard4.replica_n22, service url = null, agent id = null] for registry solr.core.halfdeletedcollection2.shard4.replica_n22 / com.codahale.metrics.MetricRegistry@47e7fced
[junit4] 2> 1440992 INFO (coreCloseExecutor-2829-thread-2) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfdeletedcollection2.shard2.replica_n10, tag=1392502140
[junit4] 2> 1440992 INFO (coreCloseExecutor-2829-thread-2) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3f41e547: rootName = solr_36593, domain = solr.core.halfdeletedcollection2.shard2.replica_n10, service url = null, agent id = null] for registry solr.core.halfdeletedcollection2.shard2.replica_n10 / com.codahale.metrics.MetricRegistry@3c7ec7af
[junit4] 2> 1440995 INFO (coreCloseExecutor-2828-thread-2) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfdeletedcollection2.shard2.replica_n6, tag=662217708
[junit4] 2> 1440995 INFO (coreCloseExecutor-2828-thread-2) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@570bdf49: rootName = solr_46055, domain = solr.core.halfdeletedcollection2.shard2.replica_n6, service url = null, agent id = null] for registry solr.core.halfdeletedcollection2.shard2.replica_n6 / com.codahale.metrics.MetricRegistry@6d39a0c9
[junit4] 2> 1440999 INFO (coreCloseExecutor-2829-thread-2) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard2 r:core_node13 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfdeletedcollection2.shard2.leader, tag=1392502140
[junit4] 2> 1440999 INFO (coreCloseExecutor-2829-thread-3) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfdeletedcollection2.shard1.replica_n2, tag=1478430147
[junit4] 2> 1441000 INFO (coreCloseExecutor-2829-thread-3) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76f5cafb: rootName = solr_36593, domain = solr.core.halfdeletedcollection2.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.halfdeletedcollection2.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@7066f723
[junit4] 2> 1441001 INFO (coreCloseExecutor-2828-thread-3) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard4 r:core_node24 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfdeletedcollection2.shard4.leader, tag=1002311413
[junit4] 2> 1441001 INFO (coreCloseExecutor-2828-thread-2) [n:127.0.0.1:46055_solr c:halfdeletedcollection2 s:shard2 r:core_node9 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfdeletedcollection2.shard2.leader, tag=662217708
[junit4] 2> 1441004 INFO (jetty-closer-1971-thread-3) [ ] o.a.s.c.Overseer Overseer (id=99231348268531723-127.0.0.1:46055_solr-n_0000000001) closing
[junit4] 2> 1441004 INFO (OverseerStateUpdate-99231348268531723-127.0.0.1:46055_solr-n_0000000001) [n:127.0.0.1:46055_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46055_solr
[junit4] 2> 1441004 WARN (OverseerAutoScalingTriggerThread-99231348268531723-127.0.0.1:46055_solr-n_0000000001) [n:127.0.0.1:46055_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1441005 INFO (zkCallback-2000-thread-4-processing-n:127.0.0.1:36593_solr) [n:127.0.0.1:36593_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36593_solr
[junit4] 2> 1441006 INFO (jetty-closer-1971-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@61f0f273{/solr,null,UNAVAILABLE}
[junit4] 2> 1441008 INFO (coreCloseExecutor-2829-thread-1) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard4 r:core_node21 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfdeletedcollection2.shard4.leader, tag=1414710963
[junit4] 2> 1441008 INFO (coreCloseExecutor-2829-thread-3) [n:127.0.0.1:36593_solr c:halfdeletedcollection2 s:shard1 r:core_node5 x:halfdeletedcollection2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfdeletedcollection2.shard1.leader, tag=1478430147
[junit4] 2> 1441011 INFO (jetty-closer-1971-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@26a5b251{/solr,null,UNAVAILABLE}
[junit4] 2> 1441011 ERROR (SUITE-TestDeleteCollectionOnDownNodes-seed#[235896DC4D7C8365]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1441012 INFO (SUITE-TestDeleteCollectionOnDownNodes-seed#[235896DC4D7C8365]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34905 34905
[junit4] 2> 1441890 INFO (Thread-1117) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34905 34905
[junit4] 2> 1441890 WARN (Thread-1117) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/collections/halfdeletedcollection2/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 2 /solr/collections/halfdeletedcollection2/leader_elect/shard2/election/99231348268531721-core_node13-n_0000000000
[junit4] 2> 2 /solr/collections/halfdeletedcollection2/leader_elect/shard4/election/99231348268531721-core_node21-n_0000000000
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestDeleteCollectionOnDownNodes_235896DC4D7C8365-001
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=18323, maxDocsPerChunk=5, blockSize=215), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=18323, blockSize=215)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@e547c98), locale=ar-TN, timezone=Indian/Maldives
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=137030248,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [SecurityConfHandlerTest, TestSolrCoreProperties, JSONWriterTest, TestAuthenticationFramework, TestLeaderElectionZkExpiry, TestGraphMLResponseWriter, TestSolrConfigHandlerCloud, TestNonDefinedSimilarityFactory, TestCharFilters, DirectSolrConnectionTest, CollectionReloadTest, XsltUpdateRequestHandlerTest, SuggesterTest, TestExactStatsCache, LegacyCloudClusterPropTest, TestCoreContainer, DocValuesNotIndexedTest, TestClusterStateMutator, TestPartialUpdateDeduplication, NumberUtilsTest, TestNumericRangeQuery32, DistribJoinFromCollectionTest, TestCollectionAPI, FieldMutatingUpdateProcessorTest, TestFunctionQuery, ZkNodePropsTest, TestRandomFlRTGCloud, PeerSyncReplicationTest, TestCloudNestedDocsSort, DistanceFunctionTest, TestMultiWordSynonyms, TestGroupingSearch, TimeZoneUtilsTest, TestPrepRecovery, OverseerTest, ExitableDirectoryReaderTest, HighlighterTest, TestSizeLimitedDistributedMap, ZkFailoverTest, TestCoreAdminApis, TestNodeAddedTrigger, BlobRepositoryCloudTest, LeaderElectionTest, TestStressUserVersions, ConfigureRecoveryStrategyTest, ShardSplitTest, TestHighFrequencyDictionaryFactory, TestLockTree, TestHttpShardHandlerFactory, TestRTimerTree, TestLMDirichletSimilarityFactory, TestDeleteCollectionOnDownNodes]
[junit4] Completed [287/765 (2!)] on J2 in 95.54s, 1 test, 1 failure <<< FAILURES!
[...truncated 49702 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build #
21145 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21145/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.UnloadDistributedZkTest
Error Message:
93 threads leaked from SUITE scope at org.apache.solr.cloud.UnloadDistributedZkTest: 1) Thread[id=11337, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 2) Thread[id=11315, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 3) Thread[id=11253, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 4) Thread[id=11393, name=zkCallback-2384-thread-6, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 5) Thread[id=11278, name=qtp1313505833-11278, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 6) Thread[id=11322, name=zkConnectionManagerCallback-2374-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 7) Thread[id=11391, name=zkCallback-2384-thread-4, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 8) Thread[id=11242, name=qtp121309220-11242, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 9) Thread[id=11343, name=qtp959788998-11343, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1562) at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1513) at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1622) at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036) at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:954) at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$293/719478773.execute(Unknown Source) at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736) at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717) at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498) at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at app//org.eclipse.jetty.server.Server.handle(Server.java:534) at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 10) Thread[id=11262, name=Thread-2815, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Object.wait(Native Method) at java.base@9.0.1/java.lang.Object.wait(Object.java:516) at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725) 11) Thread[id=11362, name=Scheduler-208758139, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 12) Thread[id=11396, name=zkCallback-2373-thread-5, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 13) Thread[id=11272, name=qtp1313505833-11272, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 14) Thread[id=11266, name=Scheduler-729495452, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 15) Thread[id=11328, name=Scheduler-952231466, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1119) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 16) Thread[id=11276, name=qtp1313505833-11276-acceptor-0@693959eb-ServerConnector@5d6177a6{HTTP/1.1,[http/1.1]}{127.0.0.1:33021}, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 17) Thread[id=11291, name=zkConnectionManagerCallback-2364-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 18) Thread[id=11269, name=searcherExecutor-4209-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 19) Thread[id=11324, name=Thread-2833, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Object.wait(Native Method) at java.base@9.0.1/java.lang.Object.wait(Object.java:516) at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725) 20) Thread[id=11254, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 21) Thread[id=11309, name=qtp1881775898-11309, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 22) Thread[id=11277, name=qtp1313505833-11277, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 23) Thread[id=11304, name=qtp1881775898-11304, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 24) Thread[id=11394, name=zkCallback-2373-thread-3, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 25) Thread[id=11395, name=zkCallback-2373-thread-4, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 26) Thread[id=11244, name=qtp121309220-11244, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 27) Thread[id=11355, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-SendThread(127.0.0.1:40293), state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 28) Thread[id=11333, name=recoveryExecutor-2370-thread-1-processing-n:127.0.0.1:33209_mrb%2Fo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at app//org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:364) at app//org.apache.solr.cloud.ZkDistributedQueue.offer(ZkDistributedQueue.java:321) at app//org.apache.solr.cloud.ZkController.publish(ZkController.java:1438) at app//org.apache.solr.cloud.ZkController.publish(ZkController.java:1342) at app//org.apache.solr.cloud.ZkController.publish(ZkController.java:1338) at app//org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:551) at app//org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:308) at app//org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:292) at app//com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) at java.base@9.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514) at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$143/509711272.run(Unknown Source) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 29) Thread[id=11344, name=qtp959788998-11344, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 30) Thread[id=11350, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 31) Thread[id=11305, name=qtp1881775898-11305, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 32) Thread[id=11249, name=org.eclipse.jetty.server.session.HashSessionManager@37196180Timer, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 33) Thread[id=11339, name=qtp959788998-11339, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 34) Thread[id=11332, name=updateExecutor-2369-thread-1-processing-n:127.0.0.1:33209_mrb%2Fo x:collection1_shard2_replica_n45 s:shard2 c:collection1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.FutureTask.awaitDone(FutureTask.java:447) at java.base@9.0.1/java.util.concurrent.FutureTask.get(FutureTask.java:190) at app//org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:339) at app//com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) at java.base@9.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514) at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$143/509711272.run(Unknown Source) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 35) Thread[id=11293, name=Thread-2824, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Object.wait(Native Method) at java.base@9.0.1/java.lang.Object.wait(Object.java:516) at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725) 36) Thread[id=11386, name=zkCallback-2363-thread-4, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 37) Thread[id=11285, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 38) Thread[id=11390, name=zkCallback-2384-thread-3, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 39) Thread[id=11274, name=qtp1313505833-11274, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 40) Thread[id=11345, name=qtp959788998-11345, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 41) Thread[id=11296, name=Scheduler-1291086313, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1119) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 42) Thread[id=11382, name=zkCallback-2353-thread-4, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 43) Thread[id=11351, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 44) Thread[id=11357, name=zkConnectionManagerCallback-2385-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 45) Thread[id=11384, name=zkCallback-2353-thread-6, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 46) Thread[id=11289, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-SendThread(127.0.0.1:40293), state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 47) Thread[id=11264, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 48) Thread[id=11320, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-SendThread(127.0.0.1:40293), state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 49) Thread[id=11346, name=org.eclipse.jetty.server.session.HashSessionManager@52efd4dcTimer, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 50) Thread[id=11243, name=qtp121309220-11243, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 51) Thread[id=11302, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 52) Thread[id=11275, name=qtp1313505833-11275, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 53) Thread[id=11383, name=zkCallback-2353-thread-5, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 54) Thread[id=11338, name=qtp959788998-11338, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 55) Thread[id=11259, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 56) Thread[id=11247, name=qtp121309220-11247, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 57) Thread[id=11392, name=zkCallback-2384-thread-5, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 58) Thread[id=11380, name=zkCallback-2353-thread-3-processing-n:127.0.0.1:42429_mrb%2Fo, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at app//org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:364) at app//org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:771) at app//org.apache.solr.cloud.Overseer.start(Overseer.java:515) at app//org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:799) at app//org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) at app//org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) at app//org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56) at app//org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348) at app//org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268) at app//org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$222/543642414.run(Unknown Source) at java.base@9.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514) at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$143/509711272.run(Unknown Source) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 59) Thread[id=11385, name=zkCallback-2353-thread-7, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 60) Thread[id=11295, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 61) Thread[id=11388, name=zkCallback-2363-thread-6, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 62) Thread[id=11359, name=Thread-2842, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Object.wait(Native Method) at java.base@9.0.1/java.lang.Object.wait(Object.java:516) at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725) 63) Thread[id=11245, name=qtp121309220-11245-acceptor-0@1f1eef9-ServerConnector@4c34f33f{HTTP/1.1,[http/1.1]}{127.0.0.1:42429}, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 64) Thread[id=11342, name=qtp959788998-11342-acceptor-0@2b39a111-ServerConnector@25fe4a06{HTTP/1.1,[http/1.1]}{127.0.0.1:41515}, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 65) Thread[id=11307, name=qtp1881775898-11307-acceptor-0@7726a8bd-ServerConnector@4cf66335{HTTP/1.1,[http/1.1]}{127.0.0.1:33209}, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424) at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252) at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 66) Thread[id=11280, name=org.eclipse.jetty.server.session.HashSessionManager@3cdde1fTimer, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 67) Thread[id=11361, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 68) Thread[id=11246, name=qtp121309220-11246, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 69) Thread[id=11387, name=zkCallback-2363-thread-5, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 70) Thread[id=11310, name=qtp1881775898-11310, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 71) Thread[id=11303, name=qtp1881775898-11303, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 72) Thread[id=11279, name=qtp1313505833-11279, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 73) Thread[id=11241, name=qtp121309220-11241, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 74) Thread[id=11356, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 75) Thread[id=11273, name=qtp1313505833-11273, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 76) Thread[id=11397, name=zkCallback-2373-thread-6, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 77) Thread[id=11306, name=qtp1881775898-11306, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 78) Thread[id=11290, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 79) Thread[id=11308, name=qtp1881775898-11308, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 80) Thread[id=11341, name=qtp959788998-11341, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 81) Thread[id=11321, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 82) Thread[id=11284, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 83) Thread[id=11340, name=qtp959788998-11340, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 84) Thread[id=11326, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 85) Thread[id=11389, name=zkCallback-2363-thread-7, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462) at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361) at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 86) Thread[id=11248, name=qtp121309220-11248, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265) at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 87) Thread[id=11271, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 88) Thread[id=11311, name=org.eclipse.jetty.server.session.HashSessionManager@6073914Timer, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131) at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 89) Thread[id=11316, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 90) Thread[id=11260, name=zkConnectionManagerCallback-2354-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 91) Thread[id=11258, name=TEST-UnloadDistributedZkTest.test-seed#[3FD193F9CEABDE6D]-SendThread(127.0.0.1:40293), state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 92) Thread[id=11300, name=searcherExecutor-4220-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844) 93) Thread[id=11331, name=searcherExecutor-4231-thread-1, state=WAITING, group=TGRP-UnloadDistributedZkTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062) at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 93 threads leaked from SUITE scope at org.apache.solr.cloud.UnloadDistributedZkTest:
1) Thread[id=11337, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
2) Thread[id=11315, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
3) Thread[id=11253, name=Connection evictor, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
4) Thread[id=11393, name=zkCallback-2384-thread-6, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awai
[...truncated too long message...]
, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171226_072513_33813900740336884321471.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20171226_072513_3388990815708576230994.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 553 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171226_072617_10812627523982817651522.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171226_072617_1083710350884204439348.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171226_072617_10816005379770014890679.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1260 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171226_072632_0659701881336592295832.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171226_072632_0651510581878379341466.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 650 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171226_072639_0625770403967421390475.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171226_072639_06216386584782706275831.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171226_072639_0626401892395851876867.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 558 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171226_072700_1839404327561270339039.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171226_072700_18310557914646101638020.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171226_072700_1837251927564030070018.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 563 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171226_072710_14312395289260520066441.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171226_072710_14312340086233613275469.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 646 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171226_072716_4926935659023797629727.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171226_072716_4912910228146496494145.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171226_072716_49111370270448965484861.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 596 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171226_072743_02910148968558593691414.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171226_072743_02913219236181032048620.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 548 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171226_072756_02618315241863100890702.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 32212 lines...]
[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+32) - Build
# 21144 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21144/
Java: 64bit/jdk-10-ea+32 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
5 tests failed.
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest
Error Message:
Error from server at http://127.0.0.1:34027/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34027/solr: create the collection time out:180s
at __randomizedtesting.SeedInfo.seed([EE4F64BE5ABCEC9F:432FD0B5478344EA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:49)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
Error Message:
Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deletereplica_test
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deletereplica_test
at __randomizedtesting.SeedInfo.seed([EE4F64BE5ABCEC9F:9EAFE004DEF34594]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup(DeleteReplicaTest.java:81)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCount
Error Message:
Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deleteByCount
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deleteByCount
at __randomizedtesting.SeedInfo.seed([EE4F64BE5ABCEC9F:82EAA0CAEDAAD9EB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCount(DeleteReplicaTest.java:111)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards
Error Message:
Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deleteByCountNew
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34027/solr: Could not fully create collection: deleteByCountNew
at __randomizedtesting.SeedInfo.seed([EE4F64BE5ABCEC9F:D2DE23EA15FDB1CA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards(DeleteReplicaTest.java:136)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple2 null Live Nodes: [127.0.0.1:41763_solr, 127.0.0.1:45255_solr] Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/13)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testSimple2_shard1_replica_n1", "base_url":"http://127.0.0.1:45255/solr", "node_name":"127.0.0.1:45255_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"testSimple2_shard1_replica_n2", "base_url":"http://127.0.0.1:36989/solr", "node_name":"127.0.0.1:36989_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testSimple2_shard2_replica_n4", "base_url":"http://127.0.0.1:45255/solr", "node_name":"127.0.0.1:45255_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node8":{ "core":"testSimple2_shard2_replica_n6", "base_url":"http://127.0.0.1:36989/solr", "node_name":"127.0.0.1:36989_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple2
null
Live Nodes: [127.0.0.1:41763_solr, 127.0.0.1:45255_solr]
Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/13)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testSimple2_shard1_replica_n1",
"base_url":"http://127.0.0.1:45255/solr",
"node_name":"127.0.0.1:45255_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"testSimple2_shard1_replica_n2",
"base_url":"http://127.0.0.1:36989/solr",
"node_name":"127.0.0.1:36989_solr",
"state":"down",
"type":"NRT"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testSimple2_shard2_replica_n4",
"base_url":"http://127.0.0.1:45255/solr",
"node_name":"127.0.0.1:45255_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node8":{
"core":"testSimple2_shard2_replica_n6",
"base_url":"http://127.0.0.1:36989/solr",
"node_name":"127.0.0.1:36989_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([EE4F64BE5ABCEC9F:D6FC40407D4F384E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:126)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 1787 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20171226_023119_46917601054788699977922.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20171226_023119_4692394198211623694033.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20171226_023119_46915906584548173462844.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 290 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171226_023925_3087596712847950393441.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171226_023925_3064160601571994161488.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171226_023925_30613690932361931784196.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1057 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171226_024046_20415401176376340932814.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171226_024046_20417998795132009649167.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171226_024046_2047319662330341159051.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 226 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171226_024213_03310957025846758819311.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171226_024213_0341457353253704727758.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171226_024213_03314943694383869822826.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 247 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171226_024225_05415766055023307960476.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 5 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171226_024225_05311635324057970940219.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171226_024225_05316230089937147517292.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 154 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171226_024253_3405045436952302851995.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171226_024253_3408585984144081435695.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171226_024253_34011056697739590978626.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 164 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20171226_024257_15914268305546311699479.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20171226_024257_1595444995878710671926.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20171226_024257_1596615615256997891731.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 168 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171226_024259_658590533735918359809.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171226_024259_6588783842239777234451.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171226_024259_65815597771188911833256.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 153 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171226_024309_4613933947383549699704.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171226_024309_4611731644510118934014.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 157 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171226_024317_9355817784262850615565.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171226_024317_93512967407881621827076.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171226_024317_93511121118360273950067.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 169 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171226_024320_48915437276756181129942.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 153 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171226_024328_434394452672775065623.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171226_024328_4348746475414457183125.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 19 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171226_024328_43417612195687130280897.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1293 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171226_024345_08616172060761013891.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171226_024345_08618130661602694286703.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171226_024345_0856040020597197227172.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 230 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20171226_024353_80815602801870309810625.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20171226_024353_8087632080133401418659.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20171226_024353_80817161642702542785635.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 250 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20171226_024403_59011408730419712968357.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 12 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20171226_024403_59016196668851093738398.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20171226_024403_59013866632816748227036.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 214 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20171226_024625_802879838840058869302.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20171226_024625_801179135336984573511.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20171226_024625_801728476550426054657.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 173 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20171226_024628_81515652193891834059704.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20171226_024628_81517601075385925598117.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20171226_024628_8159167457585319254033.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 226 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20171226_024634_36516245134141074378351.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20171226_024634_36511147965582746419024.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20171226_024634_36513273114586768440180.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 179 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20171226_024707_5701215047508313688469.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20171226_024707_5709490053381897697025.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20171226_024707_57012508488239363042486.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 240 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171226_024731_27711459847258056972808.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171226_024731_2773760491597612837857.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171226_024731_27717328047307463213689.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 160 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20171226_024754_4883158764628523160780.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20171226_024754_48414625865969632703615.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20171226_024754_48814352961491912984435.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 149 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20171226_024812_3126791587911838017418.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20171226_024812_31217151514635882583972.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 169 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20171226_024820_99311063331577485934757.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 8 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20171226_024820_993176930974298630408.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20171226_024820_9936363015577302506761.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 301 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20171226_024837_5584637038732288393847.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20171226_024837_5588095601627835918724.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20171226_024837_5587241399526003269490.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 227 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171226_024845_30513502723217152847097.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171226_024845_30517616929661384709166.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171226_024845_30517051169268581579864.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 207 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20171226_024852_5079470600651842329009.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20171226_024852_5077528103525318204922.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20171226_024852_50710523611672717963142.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 216 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171226_024904_71118426309789005628925.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171226_024904_7117428211016782479686.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 7 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171226_024904_711332850764107469687.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 317 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171226_024956_5095679717043871098467.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171226_024956_5098191699267171778826.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171226_024956_5091639052841086062016.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 148 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20171226_025014_5367223678124887276763.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 169 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171226_025016_8654205161381580295993.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171226_025016_8657133534423048934668.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 11 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171226_025016_865579782098453814646.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 247 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20171226_025134_1996229374613675984663.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20171226_025134_1996733969162989612919.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20171226_025134_19917814143707030485062.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3484 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/init-core-data-001
[junit4] 2> 1753208 WARN (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 1753208 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1753209 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1753209 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1753210 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/tempDir-001
[junit4] 2> 1753210 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1753210 INFO (Thread-3411) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1753210 INFO (Thread-3411) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1753212 ERROR (Thread-3411) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1753310 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35657
[junit4] 2> 1753311 INFO (zkConnectionManagerCallback-2923-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753313 INFO (jetty-launcher-2920-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1753313 INFO (jetty-launcher-2920-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1753313 INFO (jetty-launcher-2920-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1753313 INFO (jetty-launcher-2920-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33ce93a5{/solr,null,AVAILABLE}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b75b30c{/solr,null,AVAILABLE}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d9d361{/solr,null,AVAILABLE}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4fe24177{/solr,null,AVAILABLE}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@65102191{HTTP/1.1,[http/1.1]}{127.0.0.1:33489}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-1) [ ] o.e.j.s.Server Started @1755592ms
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33489}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3c3be2e4{HTTP/1.1,[http/1.1]}{127.0.0.1:34027}
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-2) [ ] o.e.j.s.Server Started @1755592ms
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34027}
[junit4] 2> 1753314 ERROR (jetty-launcher-2920-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1753314 ERROR (jetty-launcher-2920-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@114387ef{HTTP/1.1,[http/1.1]}{127.0.0.1:44291}
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.e.j.s.Server Started @1755593ms
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44291}
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T03:22:07.164116Z
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1753314 INFO (jetty-launcher-2920-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6cd4bf26{HTTP/1.1,[http/1.1]}{127.0.0.1:37299}
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.e.j.s.Server Started @1755593ms
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T03:22:07.164253Z
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37299}
[junit4] 2> 1753315 ERROR (jetty-launcher-2920-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1753315 ERROR (jetty-launcher-2920-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T03:22:07.164644Z
[junit4] 2> 1753315 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T03:22:07.164677Z
[junit4] 2> 1753316 INFO (zkConnectionManagerCallback-2925-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753316 INFO (zkConnectionManagerCallback-2931-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753316 INFO (zkConnectionManagerCallback-2929-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753316 INFO (zkConnectionManagerCallback-2927-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753316 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1753316 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1753316 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1753316 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1753321 INFO (jetty-launcher-2920-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35657/solr
[junit4] 2> 1753322 INFO (jetty-launcher-2920-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35657/solr
[junit4] 2> 1753323 INFO (zkConnectionManagerCallback-2936-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753324 INFO (zkConnectionManagerCallback-2939-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753324 INFO (jetty-launcher-2920-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35657/solr
[junit4] 2> 1753324 INFO (jetty-launcher-2920-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35657/solr
[junit4] 2> 1753325 INFO (zkConnectionManagerCallback-2944-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753325 INFO (zkConnectionManagerCallback-2951-thread-1-processing-n:127.0.0.1:34027_solr) [n:127.0.0.1:34027_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753325 INFO (zkConnectionManagerCallback-2947-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753325 INFO (zkConnectionManagerCallback-2949-thread-1-processing-n:127.0.0.1:44291_solr) [n:127.0.0.1:44291_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753326 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x16090d773550008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1753329 INFO (zkConnectionManagerCallback-2953-thread-1-processing-n:127.0.0.1:37299_solr) [n:127.0.0.1:37299_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753329 INFO (zkConnectionManagerCallback-2955-thread-1-processing-n:127.0.0.1:33489_solr) [n:127.0.0.1:33489_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753386 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1753386 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1753386 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1753387 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1753387 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33489_solr
[junit4] 2> 1753387 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44291_solr
[junit4] 2> 1753387 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37299_solr
[junit4] 2> 1753387 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34027_solr
[junit4] 2> 1753391 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.c.Overseer Overseer (id=99238446829469708-127.0.0.1:33489_solr-n_0000000000) starting
[junit4] 2> 1753399 INFO (zkCallback-2948-thread-1-processing-n:127.0.0.1:44291_solr) [n:127.0.0.1:44291_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1753399 INFO (zkCallback-2954-thread-1-processing-n:127.0.0.1:33489_solr) [n:127.0.0.1:33489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1753403 INFO (zkCallback-2952-thread-1-processing-n:127.0.0.1:37299_solr) [n:127.0.0.1:37299_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1753403 INFO (zkCallback-2950-thread-1-processing-n:127.0.0.1:34027_solr) [n:127.0.0.1:34027_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1753412 INFO (zkCallback-2948-thread-2-processing-n:127.0.0.1:44291_solr) [n:127.0.0.1:44291_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1753412 INFO (zkCallback-2954-thread-2-processing-n:127.0.0.1:33489_solr) [n:127.0.0.1:33489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1753432 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33489_solr
[junit4] 2> 1753433 INFO (zkCallback-2950-thread-1-processing-n:127.0.0.1:34027_solr) [n:127.0.0.1:34027_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1753433 INFO (zkCallback-2948-thread-2-processing-n:127.0.0.1:44291_solr) [n:127.0.0.1:44291_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1753435 INFO (zkCallback-2954-thread-2-processing-n:127.0.0.1:33489_solr) [n:127.0.0.1:33489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1753451 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34027.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753452 INFO (zkCallback-2952-thread-1-processing-n:127.0.0.1:37299_solr) [n:127.0.0.1:37299_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1753455 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44291.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753457 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34027.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753457 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34027.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753458 INFO (jetty-launcher-2920-thread-2) [n:127.0.0.1:34027_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/tempDir-001/node2/.
[junit4] 2> 1753460 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37299.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753463 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44291.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753463 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44291.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753464 INFO (jetty-launcher-2920-thread-4) [n:127.0.0.1:44291_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/tempDir-001/node4/.
[junit4] 2> 1753466 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37299.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753466 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37299.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753467 INFO (jetty-launcher-2920-thread-3) [n:127.0.0.1:37299_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/tempDir-001/node3/.
[junit4] 2> 1753479 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33489.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753483 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33489.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753484 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33489.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e3917d9
[junit4] 2> 1753484 INFO (jetty-launcher-2920-thread-1) [n:127.0.0.1:33489_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteReplicaTest_EE4F64BE5ABCEC9F-001/tempDir-001/node1/.
[junit4] 2> 1753549 INFO (zkConnectionManagerCallback-2965-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753550 INFO (zkConnectionManagerCallback-2969-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1753551 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1753551 INFO (SUITE-DeleteReplicaTest-seed#[EE4F64BE5ABCEC9F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35657/solr ready
[junit4] 2> 1753561 INFO (TEST-DeleteReplicaTest.deleteLiveReplicaTest-seed#[EE4F64BE5ABCEC9F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting deleteLiveReplicaTest
[junit4] 2> 1753563 INFO (qtp567527089-14689) [n:127.0.0.1:34027_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=delLiveColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1753564 INFO (OverseerThreadFactory-6799-thread-1-processing-n:127.0.0.1:33489_solr) [n:127.0.0.1:33489_solr ] o.a.s.c.CreateCollectionCmd Create collection delLiveColl
[junit4] 2> 1753674 INFO (OverseerStateUpdate-99238446829469708-127.0.0.1:33489_solr-n_0000000000) [n:127.0.0.1:33489_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"delLiveColl_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37299/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1753675 INFO (OverseerStateUpdate-99238446829469708-127.0.0.1:33489_solr-n_0000000000) [n:127.0.0.1:33489_solr ] o.a.
[...truncated too long message...]
JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171226_034315_36512168383470765340082.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20171226_034315_36514288215109741436557.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 553 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171226_034421_2308263880192190606604.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171226_034421_2308118074053686803421.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171226_034421_23010602286806321988142.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1260 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171226_034441_3405066048690092390788.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171226_034441_3407156819639911260964.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 650 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171226_034450_03911723667953877020382.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171226_034450_0398526053010071957611.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171226_034450_0397840539897832845961.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 558 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171226_034516_1393739532101324495670.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171226_034516_13912196832757749021476.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171226_034516_13915677210558161591867.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 563 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171226_034528_4304071762701820338566.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171226_034528_43016211613192483588166.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 656 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171226_034535_9151910659865977851339.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171226_034535_9157309102373264792760.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171226_034535_91517988488468241375616.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 596 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171226_034559_4544720791476189208893.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171226_034559_4544974435623343496442.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 548 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171226_034611_6955105664017154406753.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 32212 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build #
21143 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21143/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.sql.JdbcTest
Error Message:
Error from server at http://127.0.0.1:37429/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37429/solr: create the collection time out:180s
at __randomizedtesting.SeedInfo.seed([C3DF389D615F812F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.client.solrj.io.sql.JdbcTest.setupCluster(JdbcTest.java:77)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData
Error Message:
Node watch should have fired!
Stack Trace:
java.lang.AssertionError: Node watch should have fired!
at __randomizedtesting.SeedInfo.seed([B4C0EE627E6650DF:925001302AE896D5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData(TestDistribStateManager.java:256)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 1780 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20171225_233119_33513806418813305186582.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20171225_233119_3351258175815233852415.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20171225_233119_33514081854327854156263.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 299 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171225_233831_41217434772533686565424.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171225_233831_41214146564212395534019.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171225_233831_4128729759957237064179.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 1057 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171225_233943_0203708828087588696895.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171225_233943_0201798365851315018618.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171225_233943_0203689386309684615438.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 228 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171225_234118_1062084077828035146367.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171225_234118_10613316527650703148032.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171225_234118_1061435499996445884437.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 246 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171225_234128_1888256446671155955598.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171225_234128_18810081667218478603599.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 9 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171225_234128_18812307921324714424584.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 154 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171225_234154_1697060488645031683889.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171225_234154_1693256242398516798014.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171225_234154_1699193990596366230159.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 158 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J2-20171225_234158_5201788670981671989930.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J0-20171225_234158_5174352650562963580591.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/opennlp/test/temp/junit4-J1-20171225_234158_51711252392092318006827.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 168 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171225_234201_82710913158454680080256.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171225_234201_8279034668865186636370.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171225_234201_8275309606264763144522.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 153 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171225_234211_88617387747305340753006.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171225_234211_88611564688339182772759.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 154 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171225_234219_97112733895661092013045.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171225_234219_97114941730016945198714.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171225_234219_9714300275202999533161.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 169 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171225_234222_7781891725190082815535.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 153 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171225_234230_18414015563765161892341.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171225_234230_1843346398754356845600.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 19 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171225_234230_18413938633416068901974.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 1293 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171225_234249_7199072593760774798102.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171225_234249_71912053719332871760173.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171225_234249_7197634522822154412915.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 230 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20171225_234258_9532347189312992859536.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20171225_234258_9533434359425794690644.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20171225_234258_953307730951930841668.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 260 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20171225_234310_06510849904901966998371.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20171225_234310_0656759821430556731292.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20171225_234310_0659149801477766275010.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 211 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20171225_234528_8986255302235629365206.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20171225_234528_89818113514749957663378.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20171225_234528_8989767036042921647246.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 167 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20171225_234531_6632844887665901574419.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20171225_234531_66311678307160287322814.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20171225_234531_66316715902065341428003.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 226 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20171225_234537_1289062445711746379177.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20171225_234537_12815295448901927342211.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20171225_234537_1282116133870254098846.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 176 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20171225_234609_1513460744431457049415.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20171225_234609_1524237360366725481918.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20171225_234609_15217098829954977881374.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 243 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171225_234621_79015455639694788481873.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171225_234621_7903798654356344850593.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171225_234621_7905128538137318702246.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 160 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20171225_234642_74511829417317045041259.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20171225_234642_74516118219104268307645.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20171225_234642_74516130235215527418610.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 149 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20171225_234701_1365649031540945968994.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20171225_234701_1367774518233544460524.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 178 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20171225_234710_05011853001690794027439.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20171225_234710_0504095652402957239251.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20171225_234710_0506306257499575664604.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 298 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20171225_234725_26817187542755762431322.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20171225_234725_26817450222164574966595.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20171225_234725_26817538666124683295012.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 224 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171225_234732_35317954039979614591403.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171225_234732_3539961049460112397104.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171225_234732_353734534847713106806.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 199 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20171225_234739_1351562956375049339344.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 8 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20171225_234739_1356186322978245328970.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20171225_234739_13516060324893271121869.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 202 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171225_234751_41815467937279264207742.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171225_234751_41812068418342397939342.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 21 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171225_234751_418650112696514402733.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 317 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171225_234834_56616467489615939703674.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171225_234834_5664775889753056255871.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171225_234834_566584935845586547613.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 148 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20171225_234848_4283344545640393747973.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 175 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171225_234850_1595702466933899186465.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171225_234850_15915267913450892706591.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 5 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171225_234850_15915101264987133834628.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 241 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20171225_234932_3182758684588126523068.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20171225_234932_31813198865229133916706.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 15 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20171225_234932_3185417218095478574094.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 1679 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager
[junit4] 2> 27064 INFO (SUITE-TestDistribStateManager-seed#[B4C0EE627E6650DF]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestDistribStateManager_B4C0EE627E6650DF-001/init-core-data-001
[junit4] 2> 27064 WARN (SUITE-TestDistribStateManager-seed#[B4C0EE627E6650DF]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 27065 INFO (SUITE-TestDistribStateManager-seed#[B4C0EE627E6650DF]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 27065 INFO (SUITE-TestDistribStateManager-seed#[B4C0EE627E6650DF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 27242 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testHasData
[junit4] 2> 27243 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 27257 INFO (Thread-11) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 27257 INFO (Thread-11) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 27286 ERROR (Thread-11) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 27357 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer start zk server on port:37703
[junit4] 2> 27362 INFO (zkConnectionManagerCallback-22-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 27362 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 27371 ERROR (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 27371 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37703 37703
[junit4] 2> 36963 INFO (Thread-11) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37703 37703
[junit4] 2> 36964 INFO (TEST-TestDistribStateManager.testHasData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testHasData
[junit4] 2> 36965 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMulti
[junit4] 2> 36966 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 36966 INFO (Thread-12) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 36966 INFO (Thread-12) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 36967 ERROR (Thread-12) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 37066 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer start zk server on port:36399
[junit4] 2> 37069 INFO (zkConnectionManagerCallback-24-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 37070 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 37071 ERROR (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 37073 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36399 36399
[junit4] 2> 42116 INFO (Thread-12) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36399 36399
[junit4] 2> 42117 INFO (TEST-TestDistribStateManager.testMulti-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMulti
[junit4] 2> 42126 INFO (TEST-TestDistribStateManager.testListData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testListData
[junit4] 2> 42127 INFO (TEST-TestDistribStateManager.testListData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 42128 INFO (TEST-TestDistribStateManager.testListData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testListData
[junit4] 2> 42129 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testGetSetRemoveData
[junit4] 2> 42130 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 42130 INFO (Thread-13) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 42130 INFO (Thread-13) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 42134 ERROR (Thread-13) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 42230 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer start zk server on port:46369
[junit4] 2> 42234 INFO (zkConnectionManagerCallback-26-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 42235 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 42241 INFO (zkConnectionManagerCallback-28-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 42241 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 47242 ERROR (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 47242 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46369 46369
[junit4] 2> 48562 INFO (Thread-13) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46369 46369
[junit4] 2> 48563 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testGetSetRemoveData
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistribStateManager -Dtests.method=testGetSetRemoveData -Dtests.seed=B4C0EE627E6650DF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=xog -Dtests.timezone=Asia/Phnom_Penh -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 6.44s J1 | TestDistribStateManager.testGetSetRemoveData <<<
[junit4] > Throwable #1: java.lang.AssertionError: Node watch should have fired!
[junit4] > at __randomizedtesting.SeedInfo.seed([B4C0EE627E6650DF:925001302AE896D5]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData(TestDistribStateManager.java:256)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 48569 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateMode
[junit4] 2> 48570 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 48570 INFO (Thread-14) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 48570 INFO (Thread-14) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 48577 ERROR (Thread-14) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 48670 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer start zk server on port:45201
[junit4] 2> 48673 INFO (zkConnectionManagerCallback-30-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 48673 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 48687 INFO (zkConnectionManagerCallback-32-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 48687 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 48690 ERROR (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 48694 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45201 45201
[junit4] 2> 49443 INFO (Thread-14) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45201 45201
[junit4] 2> 49444 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[B4C0EE627E6650DF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateMode
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestDistribStateManager_B4C0EE627E6650DF-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@307a6714), locale=xog, timezone=Asia/Phnom_Penh
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=374461656,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [MetricTriggerTest, TestDistribStateManager]
[junit4] Completed [22/765 (1!)] on J1 in 22.42s, 5 tests, 1 failure <<< FAILURES!
[...truncated 2518 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20171225_235029_5084462957653708530797.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J2-20171225_235029_50811800670639151841946.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20171225_235029_5089112881311871388750.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 845 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J2-20171226_003503_4443592578856428107381.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20171226_003503_4437812601045112343603.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 2 lines...]
[junit4] Suite: org.apache.solr.client.solrj.io.sql.JdbcTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/init-core-data-001
[junit4] 2> 21167 WARN (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
[junit4] 2> 21167 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 21168 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 21168 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 21168 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001
[junit4] 2> 21168 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 21169 INFO (Thread-380) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 21169 INFO (Thread-380) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 21180 ERROR (Thread-380) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 21269 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46409
[junit4] 2> 21271 INFO (zkConnectionManagerCallback-97-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21273 INFO (jetty-launcher-94-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 21273 INFO (jetty-launcher-94-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 21274 INFO (jetty-launcher-94-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@410788b{/solr,null,AVAILABLE}
[junit4] 2> 21274 INFO (jetty-launcher-94-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50436acb{/solr,null,AVAILABLE}
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5a968aa3{HTTP/1.1,[http/1.1]}{127.0.0.1:37429}
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@397202fa{HTTP/1.1,[http/1.1]}{127.0.0.1:42125}
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-1) [ ] o.e.j.s.Server Started @22764ms
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-2) [ ] o.e.j.s.Server Started @22764ms
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42125}
[junit4] 2> 21276 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37429}
[junit4] 2> 21276 ERROR (jetty-launcher-94-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 21276 ERROR (jetty-launcher-94-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T00:35:26.229121Z
[junit4] 2> 21277 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-26T00:35:26.229131Z
[junit4] 2> 21281 INFO (zkConnectionManagerCallback-100-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21281 INFO (zkConnectionManagerCallback-101-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21281 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 21282 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 21288 INFO (jetty-launcher-94-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46409/solr
[junit4] 2> 21289 INFO (jetty-launcher-94-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46409/solr
[junit4] 2> 21290 INFO (zkConnectionManagerCallback-105-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21292 INFO (zkConnectionManagerCallback-109-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21294 INFO (zkConnectionManagerCallback-111-thread-1-processing-n:127.0.0.1:42125_solr) [n:127.0.0.1:42125_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21294 INFO (zkConnectionManagerCallback-113-thread-1-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21305 WARN (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 21305 WARN (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 21308 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 21308 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 21308 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37429_solr
[junit4] 2> 21309 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.Overseer Overseer (id=99237791407931398-127.0.0.1:37429_solr-n_0000000000) starting
[junit4] 2> 21309 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42125_solr
[junit4] 2> 21324 INFO (zkCallback-110-thread-1-processing-n:127.0.0.1:42125_solr) [n:127.0.0.1:42125_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 21324 INFO (zkCallback-112-thread-1-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 21337 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37429_solr
[junit4] 2> 21340 INFO (zkCallback-110-thread-1-processing-n:127.0.0.1:42125_solr) [n:127.0.0.1:42125_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 21342 INFO (zkCallback-112-thread-1-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 21384 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42125.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21396 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37429.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21398 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42125.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21398 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42125.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21400 INFO (jetty-launcher-94-thread-2) [n:127.0.0.1:42125_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node2/.
[junit4] 2> 21412 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37429.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21412 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37429.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 21427 INFO (jetty-launcher-94-thread-1) [n:127.0.0.1:37429_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node1/.
[junit4] 2> 21457 INFO (zkConnectionManagerCallback-119-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21461 INFO (zkConnectionManagerCallback-123-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 21463 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 21463 INFO (SUITE-JdbcTest-seed#[C3DF389D615F812F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46409/solr ready
[junit4] 2> 21469 INFO (qtp2069511409-924) [n:127.0.0.1:37429_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=collection1_collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 21474 INFO (OverseerThreadFactory-462-thread-1-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.CreateCollectionCmd Create collection collection1_collection
[junit4] 2> 21580 INFO (OverseerStateUpdate-99237791407931398-127.0.0.1:37429_solr-n_0000000000) [n:127.0.0.1:37429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37429/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 21582 INFO (OverseerStateUpdate-99237791407931398-127.0.0.1:37429_solr-n_0000000000) [n:127.0.0.1:37429_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42125/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 21787 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 21787 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 21787 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 21787 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 21893 INFO (zkCallback-112-thread-1-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1_collection/state.json] for collection [collection1_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 21893 INFO (zkCallback-110-thread-1-processing-n:127.0.0.1:42125_solr) [n:127.0.0.1:42125_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1_collection/state.json] for collection [collection1_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 21893 INFO (zkCallback-112-thread-2-processing-n:127.0.0.1:37429_solr) [n:127.0.0.1:37429_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1_collection/state.json] for collection [collection1_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 21894 INFO (zkCallback-110-thread-2-processing-n:127.0.0.1:42125_solr) [n:127.0.0.1:42125_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1_collection/state.json] for collection [collection1_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 22800 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 22804 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 22812 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.s.IndexSchema [collection1_collection_shard2_replica_n2] Schema name=test
[junit4] 2> 22819 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 22878 WARN (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 22879 WARN (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 22879 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 22879 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_collection_shard2_replica_n2' using configuration from collection collection1_collection, trusted=true
[junit4] 2> 22881 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42125.solr.core.collection1_collection.shard2.replica_n2' (registry 'solr.core.collection1_collection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 22881 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 22881 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SolrCore [[collection1_collection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node2/collection1_collection_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node2/./collection1_collection_shard2_replica_n2/data/]
[junit4] 2> 22920 WARN (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 22921 WARN (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 22921 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 22921 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_collection_shard1_replica_n1' using configuration from collection collection1_collection, trusted=true
[junit4] 2> 22922 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37429.solr.core.collection1_collection.shard1.replica_n1' (registry 'solr.core.collection1_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc54ed0
[junit4] 2> 22922 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 22922 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node1/collection1_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.sql.JdbcTest_C3DF389D615F812F-001/tempDir-001/node1/./collection1_collection_shard1_replica_n1/data/]
[junit4] 2> 22951 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 22951 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 22952 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 22953 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 22954 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@52b91322[collection1_collection_shard2_replica_n2] main]
[junit4] 2> 22955 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 22956 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 22956 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 22959 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 22959 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 22960 INFO (searcherExecutor-467-thread-1-processing-n:127.0.0.1:42125_solr x:collection1_collection_shard2_replica_n2 s:shard2 c:collection1_collection r:core_node4) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SolrCore [collection1_collection_shard2_replica_n2] Registered new searcher Searcher@52b91322[collection1_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 22961 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587804664404901888
[junit4] 2> 22964 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 22964 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42125/solr/collection1_collection_shard2_replica_n2/
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:42125/solr/collection1_collection_shard2_replica_n2/ has no replicas
[junit4] 2> 22966 INFO (qtp175656812-923) [n:127.0.0.1:42125_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 22966 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@32ec36c8[collection1_collection_shard1_replica_n1] main]
[junit4] 2> 22967 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 22967 INFO (qtp2069511409-916) [n:127.0.0.1:37429_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 22968 INFO
[...truncated too long message...]
ee: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20171226_004047_88410423990464600517827.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20171226_004047_88410212342109832283187.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 553 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171226_004144_67610328118982898313574.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171226_004144_67615204657376498396800.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171226_004144_67612144315947873913960.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1260 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171226_004157_65611814791108686414819.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171226_004157_65615548908253379826226.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 647 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171226_004203_70416669035255269642229.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171226_004203_70415504012373523128006.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171226_004203_70412419688505164642350.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 558 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171226_004225_11216840570768037653630.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171226_004225_11211522905182122991873.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171226_004225_11215719838404330408566.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 563 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171226_004234_2246230476593824102174.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171226_004234_224667853448122015375.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 652 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171226_004239_9658638324652138464459.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171226_004239_8693068136568955490447.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171226_004239_96510037515630781096151.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 599 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171226_004304_25216555309008324663056.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171226_004304_2523488772884266225093.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 548 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171226_004313_2742959745260238771773.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 32212 lines...]
[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build #
21142 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21142/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null
at __randomizedtesting.SeedInfo.seed([B55121DC5EFD4B49:FD24556858CE64DC]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:550)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1013)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:461)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (http://127.0.0.1:37851/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:527)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test
Error Message:
Trigger was not fired
Stack Trace:
java.lang.AssertionError: Trigger was not fired
at __randomizedtesting.SeedInfo.seed([B55121DC5EFD4B49:3D051E06F00126B1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:151)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12330 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.SystemLogListenerTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/init-core-data-001
[junit4] 2> 739201 WARN (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=81 numCloses=81
[junit4] 2> 739201 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 739203 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 739203 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 739204 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001
[junit4] 2> 739204 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 739204 INFO (Thread-3333) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 739204 INFO (Thread-3333) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 739206 ERROR (Thread-3333) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 739304 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38309
[junit4] 2> 739306 INFO (zkConnectionManagerCallback-1304-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739335 INFO (jetty-launcher-1301-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 739335 INFO (jetty-launcher-1301-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 739337 INFO (jetty-launcher-1301-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 739350 INFO (jetty-launcher-1301-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@efd2ec{/solr,null,AVAILABLE}
[junit4] 2> 739354 INFO (jetty-launcher-1301-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13e2146{/solr,null,AVAILABLE}
[junit4] 2> 739354 INFO (jetty-launcher-1301-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@151241f{/solr,null,AVAILABLE}
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3cccd3{SSL,[ssl, http/1.1]}{127.0.0.1:33033}
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.e.j.s.Server Started @741874ms
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33033}
[junit4] 2> 739355 ERROR (jetty-launcher-1301-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 739355 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T21:09:38.721Z
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@cf1bc7{SSL,[ssl, http/1.1]}{127.0.0.1:46107}
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.e.j.s.Server Started @741876ms
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46107}
[junit4] 2> 739357 ERROR (jetty-launcher-1301-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 739357 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T21:09:38.723Z
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1f64e52{SSL,[ssl, http/1.1]}{127.0.0.1:36299}
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.e.j.s.Server Started @741881ms
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36299}
[junit4] 2> 739362 ERROR (jetty-launcher-1301-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 739362 INFO (zkConnectionManagerCallback-1308-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 739362 INFO (zkConnectionManagerCallback-1306-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 739362 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T21:09:38.728Z
[junit4] 2> 739363 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 739363 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 739368 INFO (zkConnectionManagerCallback-1310-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739368 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 739372 INFO (jetty-launcher-1301-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38309/solr
[junit4] 2> 739373 INFO (jetty-launcher-1301-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38309/solr
[junit4] 2> 739377 INFO (zkConnectionManagerCallback-1315-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739381 INFO (zkConnectionManagerCallback-1318-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739382 INFO (jetty-launcher-1301-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38309/solr
[junit4] 2> 739386 INFO (zkConnectionManagerCallback-1322-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739388 INFO (zkConnectionManagerCallback-1324-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739389 INFO (zkConnectionManagerCallback-1326-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739389 INFO (zkConnectionManagerCallback-1328-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739422 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 739422 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 739423 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33033_solr
[junit4] 2> 739423 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36299_solr
[junit4] 2> 739423 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.Overseer Overseer (id=99236982198829062-127.0.0.1:33033_solr-n_0000000000) starting
[junit4] 2> 739423 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 739424 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 739424 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46107_solr
[junit4] 2> 739426 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 739426 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 739426 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 739434 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 739434 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 739434 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33033_solr
[junit4] 2> 739435 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36299_solr, 127.0.0.1:46107_solr]
[junit4] 2> 739435 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 739435 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 739438 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 739438 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 739438 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 739441 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 739442 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 739442 DEBUG (ScheduledTrigger-2599-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 739539 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739539 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739539 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739546 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739546 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739547 INFO (jetty-launcher-1301-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/.
[junit4] 2> 739547 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739547 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739548 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739548 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 739549 INFO (jetty-launcher-1301-thread-2) [n:127.0.0.1:36299_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/.
[junit4] 2> 739549 INFO (jetty-launcher-1301-thread-3) [n:127.0.0.1:46107_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/.
[junit4] 2> 739603 INFO (zkConnectionManagerCallback-1336-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739605 INFO (zkConnectionManagerCallback-1340-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 739606 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 739606 INFO (SUITE-SystemLogListenerTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38309/solr ready
[junit4] 2> 739630 INFO (qtp5710183-8304) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=.system&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 739634 INFO (OverseerThreadFactory-2601-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.CreateCollectionCmd Create collection .system
[junit4] 2> 739742 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46107/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 739743 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33033/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 739744 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:36299/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 739950 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 739951 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 739990 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 739990 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 739990 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 739990 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 740093 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740093 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740093 INFO (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740093 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740094 INFO (zkCallback-1325-thread-2-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740094 INFO (zkCallback-1327-thread-2-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 740443 DEBUG (ScheduledTrigger-2599-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 740966 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 740972 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 740974 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.IndexSchema [.system_shard1_replica_n4] Schema name=_system collection or core
[junit4] 2> 740979 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 740980 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 740981 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 740981 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n4' using configuration from collection .system, trusted=true
[junit4] 2> 740982 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.core..system.shard1.replica_n4' (registry 'solr.core..system.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 740982 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 740982 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrCore [[.system_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/.system_shard1_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/./.system_shard1_replica_n4/data/]
[junit4] 2> 740997 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 740998 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 741001 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 741002 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 741004 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 741004 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from collection .system, trusted=true
[junit4] 2> 741004 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 741004 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 741004 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/.system_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/./.system_shard1_replica_n2/data/]
[junit4] 2> 741005 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 741005 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
[junit4] 2> 741005 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 741005 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 741005 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/./.system_shard1_replica_n1/data/]
[junit4] 2> 741018 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 741018 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 741019 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 741019 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 741020 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ceb1fd[.system_shard1_replica_n4] main]
[junit4] 2> 741021 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 741021 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 741021 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 741021 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 741021 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 741037 INFO (searcherExecutor-2608-thread-1-processing-n:127.0.0.1:36299_solr x:.system_shard1_replica_n4 s:shard1 c:.system r:core_node6) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrCore [.system_shard1_replica_n4] Registered new searcher Searcher@1ceb1fd[.system_shard1_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 741037 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587791717102256128
[junit4] 2> 741040 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=3 found=1 timeoutin=9999ms
[junit4] 2> 741048 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 741048 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 741049 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 741049 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 741049 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 741049 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 741050 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 741050 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 741050 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@d3be48[.system_shard1_replica_n2] main]
[junit4] 2> 741051 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17be9f7[.system_shard1_replica_n1] main]
[junit4] 2> 741051 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 741051 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 741051 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 741051 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 741051 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 741052 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 741052 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 741052 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 741052 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 741052 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 741052 INFO (searcherExecutor-2609-thread-1-processing-n:127.0.0.1:33033_solr x:.system_shard1_replica_n2 s:shard1 c:.system r:core_node5) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@d3be48[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 741052 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587791717117984768
[junit4] 2> 741053 INFO (searcherExecutor-2610-thread-1-processing-n:127.0.0.1:46107_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node3) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@17be9f7[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 741053 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587791717119033344
[junit4] 2> 741141 INFO (zkCallback-1325-thread-2-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741141 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741142 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741141 INFO (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741141 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741141 INFO (zkCallback-1327-thread-2-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741444 DEBUG (ScheduledTrigger-2599-thread-2) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 741541 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 741541 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 741541 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36299/solr/.system_shard1_replica_n4/
[junit4] 2> 741542 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n4 url=https://127.0.0.1:36299/solr START replicas=[https://127.0.0.1:46107/solr/.system_shard1_replica_n1/, https://127.0.0.1:33033/solr/.system_shard1_replica_n2/] nUpdates=100
[junit4] 2> 741547 INFO (qtp8456863-8288) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 741547 INFO (qtp32881867-8293) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 741842 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n4 url=https://127.0.0.1:36299/solr DONE. We have no versions. sync failed.
[junit4] 2> 741842 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 741842 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 741842 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 741848 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36299/solr/.system_shard1_replica_n4/ shard1
[junit4] 2> 741950 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741950 INFO (zkCallback-1327-thread-2-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741950 INFO (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741950 INFO (zkCallback-1325-thread-2-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741950 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741950 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 741999 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 742001 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2050
[junit4] 2> 742056 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2066
[junit4] 2> 742065 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2074
[junit4] 2> 742067 INFO (qtp5710183-8304) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 742157 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742157 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742157 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742157 INFO (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742157 INFO (zkCallback-1327-thread-2-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742157 INFO (zkCallback-1325-thread-2-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 742444 DEBUG (ScheduledTrigger-2599-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 743067 INFO (qtp5710183-8304) [n:127.0.0.1:36299_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=3&name=.system&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3436
[junit4] 2> 743097 INFO (TEST-SystemLogListenerTest.test-seed#[B55121DC5EFD4B49]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 743107 INFO (qtp5710183-8286) [n:127.0.0.1:36299_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743111 INFO (qtp8456863-8288) [n:127.0.0.1:46107_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743115 INFO (qtp32881867-8308) [n:127.0.0.1:33033_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743115 DEBUG (qtp5710183-8284) [n:127.0.0.1:36299_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 743118 INFO (qtp5710183-8284) [n:127.0.0.1:36299_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=15
[junit4] 2> 743119 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 743123 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36299_solr, 127.0.0.1:33033_solr, 127.0.0.1:46107_solr]
[junit4] 2> 743124 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36299_solr, 127.0.0.1:33033_solr, 127.0.0.1:46107_solr]
[junit4] 2> 743124 INFO (qtp5710183-8285) [n:127.0.0.1:36299_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743124 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 743126 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743127 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 743128 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 743128 DEBUG (ScheduledTrigger-2599-thread-2) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 3
[junit4] 2> 743128 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 743129 DEBUG (qtp5710183-8303) [n:127.0.0.1:36299_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 743129 INFO (qtp5710183-8303) [n:127.0.0.1:36299_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=10
[junit4] 2> 743130 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 743130 INFO (qtp5710183-8304) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=3&name=test&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 743130 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36299_solr, 127.0.0.1:33033_solr, 127.0.0.1:46107_solr]
[junit4] 2> 743130 DEBUG (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36299_solr, 127.0.0.1:33033_solr, 127.0.0.1:46107_solr]
[junit4] 2> 743131 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 743131 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 743131 DEBUG (OverseerAutoScalingTriggerThread-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 743131 INFO (OverseerThreadFactory-2601-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.CreateCollectionCmd Create collection test
[junit4] 2> 743131 INFO (OverseerCollectionConfigSetProcessor-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 743337 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"test_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33033/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743338 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"test_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46107/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743339 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"test_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:36299/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743340 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"test_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33033/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743340 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"test_shard3_replica_n8",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46107/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743341 INFO (OverseerStateUpdate-99236982198829062-127.0.0.1:33033_solr-n_0000000000) [n:127.0.0.1:33033_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"test_shard3_replica_n10",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:36299/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 743444 DEBUG (ScheduledTrigger-2599-thread-1) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 743543 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=test_shard2_replica_n4&action=CREATE&numShards=3&collection=test&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743544 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=test_shard1_replica_n1&action=CREATE&numShards=3&collection=test&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743543 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=test_shard1_replica_n2&action=CREATE&numShards=3&collection=test&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743545 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=test_shard3_replica_n8&action=CREATE&numShards=3&collection=test&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743545 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node12&collection.configName=conf&newCollection=true&name=test_shard3_replica_n10&action=CREATE&numShards=3&collection=test&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743546 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=test_shard2_replica_n6&action=CREATE&numShards=3&collection=test&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 743648 INFO (zkCallback-1325-thread-2-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 743648 INFO (zkCallback-1327-thread-1-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 743648 INFO (zkCallback-1321-thread-1-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 743648 INFO (zkCallback-1325-thread-1-processing-n:127.0.0.1:46107_solr) [n:127.0.0.1:46107_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 743648 INFO (zkCallback-1321-thread-2-processing-n:127.0.0.1:33033_solr) [n:127.0.0.1:33033_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 743648 INFO (zkCallback-1327-thread-2-processing-n:127.0.0.1:36299_solr) [n:127.0.0.1:36299_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [3])
[junit4] 2> 744129 DEBUG (ScheduledTrigger-2599-thread-4) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 3
[junit4] 2> 744444 DEBUG (ScheduledTrigger-2599-thread-3) [n:127.0.0.1:33033_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 744558 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744558 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744558 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744559 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744566 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.s.IndexSchema [test_shard3_replica_n8] Schema name=minimal
[junit4] 2> 744567 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744567 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 744568 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.s.IndexSchema [test_shard1_replica_n2] Schema name=minimal
[junit4] 2> 744569 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.s.IndexSchema [test_shard1_replica_n1] Schema name=minimal
[junit4] 2> 744569 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744569 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.c.CoreContainer Creating SolrCore 'test_shard3_replica_n8' using configuration from collection test, trusted=true
[junit4] 2> 744570 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.s.IndexSchema [test_shard2_replica_n6] Schema name=minimal
[junit4] 2> 744570 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.core.test.shard3.replica_n8' (registry 'solr.core.test.shard3.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744570 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744570 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744570 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'test_shard1_replica_n2' using configuration from collection test, trusted=true
[junit4] 2> 744570 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.c.SolrCore [[test_shard3_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/test_shard3_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/./test_shard3_replica_n8/data/]
[junit4] 2> 744571 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46107.solr.core.test.shard1.replica_n2' (registry 'solr.core.test.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744571 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744571 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.c.SolrCore [[test_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/test_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node3/./test_shard1_replica_n2/data/]
[junit4] 2> 744572 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744572 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'test_shard1_replica_n1' using configuration from collection test, trusted=true
[junit4] 2> 744573 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.core.test.shard1.replica_n1' (registry 'solr.core.test.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744573 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744574 INFO (qtp32881867-8290) [n:127.0.0.1:33033_solr c:test s:shard1 r:core_node3 x:test_shard1_replica_n1] o.a.s.c.SolrCore [[test_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/test_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/./test_shard1_replica_n1/data/]
[junit4] 2> 744574 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744574 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'test_shard2_replica_n6' using configuration from collection test, trusted=true
[junit4] 2> 744575 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33033.solr.core.test.shard2.replica_n6' (registry 'solr.core.test.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744575 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744575 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.c.SolrCore [[test_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/test_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node1/./test_shard2_replica_n6/data/]
[junit4] 2> 744581 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.s.IndexSchema [test_shard3_replica_n10] Schema name=minimal
[junit4] 2> 744582 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.s.IndexSchema [test_shard2_replica_n4] Schema name=minimal
[junit4] 2> 744583 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744583 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.c.CoreContainer Creating SolrCore 'test_shard3_replica_n10' using configuration from collection test, trusted=true
[junit4] 2> 744585 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 744585 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'test_shard2_replica_n4' using configuration from collection test, trusted=true
[junit4] 2> 744585 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.core.test.shard2.replica_n4' (registry 'solr.core.test.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744585 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744586 INFO (qtp5710183-8301) [n:127.0.0.1:36299_solr c:test s:shard2 r:core_node7 x:test_shard2_replica_n4] o.a.s.c.SolrCore [[test_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/test_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/./test_shard2_replica_n4/data/]
[junit4] 2> 744586 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36299.solr.core.test.shard3.replica_n10' (registry 'solr.core.test.shard3.replica_n10') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@185d0fd
[junit4] 2> 744586 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 744586 INFO (qtp5710183-8292) [n:127.0.0.1:36299_solr c:test s:shard3 r:core_node12 x:test_shard3_replica_n10] o.a.s.c.SolrCore [[test_shard3_replica_n10] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/test_shard3_replica_n10], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_B55121DC5EFD4B49-001/tempDir-001/node2/./test_shard3_replica_n10/data/]
[junit4] 2> 744635 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 744635 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 744636 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 744636 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 744637 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 744637 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 744637 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 744637 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 744637 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@6376d9[test_shard2_replica_n6] main]
[junit4] 2> 744638 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 744638 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 744638 INFO (qtp32881867-8307) [n:127.0.0.1:33033_solr c:test s:shard2 r:core_node9 x:test_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 744638 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 744638 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 744640 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@60824f[test_shard1_replica_n2] main]
[junit4] 2> 744640 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ea224c[test_shard3_replica_n8] main]
[junit4] 2> 744640 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 744640 INFO (qtp8456863-8287) [n:127.0.0.1:46107_solr c:test s:shard3 r:core_node11 x:test_shard3_replica_n8] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 744641 INFO (qtp8456863-8297) [n:127.0.0.1:46107_solr c:test s:shard1 r:core_node5 x:test_shard1_replica_n2] o.a.s.r.ManagedResourceStorag
[...truncated too long message...]
&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=9002
[junit4] 2> 1313848 ERROR (qtp7368954-10823) [n:127.0.0.1:44699_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Solr is shutting down
[junit4] 2> at org.apache.solr.handler.admin.PrepRecoveryOp.execute(PrepRecoveryOp.java:171)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1313848 INFO (qtp7368954-10823) [n:127.0.0.1:44699_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:37851_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica_n3&coreNodeName=core_node13&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=9001
[junit4] 2> 1313848 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1313849 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[B55121DC5EFD4B49]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36747 36747
[junit4] 2> 1313855 INFO (Thread-2011) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36747 36747
[junit4] 2> 1313857 WARN (Thread-2011) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/configs/conf
[junit4] 2> 18 /solr/aliases.json
[junit4] 2> 18 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 52 /solr/collections/addReplicaColl/state.json
[junit4] 2> 36 /solr/collections/reloaded_collection/state.json
[junit4] 2> 32 /solr/collections/nodes_used_collection/state.json
[junit4] 2> 18 /solr/clusterstate.json
[junit4] 2> 16 /solr/collections/halfdeletedcollection/state.json
[junit4] 2> 15 /solr/collections/acollectionafterbaddelete/state.json
[junit4] 2> 10 /solr/collections/onlyinzk/state.json
[junit4] 2> 5 /solr/collections/halfcollectionblocker/state.json
[junit4] 2> 5 /solr/collections/created_and_deleted/state.json
[junit4] 2> 5 /solr/collections/halfcollectionblocker2/state.json
[junit4] 2> 5 /solr/collections/withconfigset2/state.json
[junit4] 2> 4 /solr/collections/halfcollection/state.json
[junit4] 2> 2 /solr/collections/addReplicaColl/leader_elect/shard1/election/99237012709834764-core_node5-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 350 /solr/collections
[junit4] 2> 18 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B55121DC5EFD4B49-001
[junit4] 2> Dec 25, 2017 9:19:13 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=649, maxMBSortInHeap=6.50240830932457, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@57692), locale=hu, timezone=America/Campo_Grande
[junit4] 2> NOTE: Linux 4.10.0-40-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=183699256,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestAtomicUpdateErrorCases, TestLuceneMatchVersion, HLLUtilTest, AddBlockUpdateTest, TestSolrCloudSnapshots, CdcrVersionReplicationTest, AnalyticsQueryTest, TestExactSharedStatsCache, SOLR749Test, TestAnalyzedSuggestions, SearchHandlerTest, BinaryUpdateRequestHandlerTest, TestStressReorder, TestTlogReplica, DateRangeFieldTest, TestSchemaResource, TimeRoutedAliasUpdateProcessorTest, CdcrReplicationDistributedZkTest, LeaderFailoverAfterPartitionTest, TestNumericTerms32, PingRequestHandlerTest, SolrIndexConfigTest, SpatialRPTFieldTypeTest, TestDistribStateManager, TestCryptoKeys, TestEmbeddedSolrServerAdminHandler, ChaosMonkeySafeLeaderTest, AssignTest, BooleanFieldTest, TestBM25SimilarityFactory, TestDynamicFieldResource, TestPointFields, TestDocSet, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestFieldCacheVsDocValues, GraphQueryTest, MissingSegmentRecoveryTest, TestSerializedLuceneMatchVersion, TestPerFieldSimilarity, DistributedFacetPivotWhiteBoxTest, MoveReplicaTest, TestSurroundQueryParser, RequestHandlersTest, MetricTriggerTest, TestJmxIntegration, SynonymTokenizerTest, OpenExchangeRatesOrgProviderTest, TestFieldTypeCollectionResource, TestRetrieveFieldsOptimizer, TestLeaderElectionWithEmptyReplica, TestOmitPositions, TestXIncludeConfig, TestFieldCacheReopen, TestLegacyFieldReuse, TestCursorMarkWithoutUniqueKey, TestSha256AuthenticationProvider, TestAnalyzeInfixSuggestions, TestFastWriter, TestReRankQParserPlugin, HdfsLockFactoryTest, TestOverriddenPrefixQueryForCustomFieldType, SaslZkACLProviderTest, NumericFieldsTest, DOMUtilTest, MetricsConfigTest, TestSimpleTextCodec, BlockJoinFacetDistribTest, ShardRoutingTest, DebugComponentTest, TestSolrCloudWithHadoopAuthPlugin, OutputWriterTest, TestCoreBackup, QueryEqualityTest, SampleTest, DirectoryFactoryTest, TestSearcherReuse, TestAddFieldRealTimeGet, QueryResultKeyTest, ClassificationUpdateProcessorTest, HdfsRestartWhileUpdatingTest, TestSolrCloudWithDelegationTokens, TestLocalFSCloudBackupRestore, TestImplicitCoreProperties, DocValuesMultiTest, TestNRTOpen, TestCloudSchemaless, TestGeoJSONResponseWriter, MergeStrategyTest, WrapperMergePolicyFactoryTest, TestClusterProperties, TestLargeCluster, TestStressCloudBlindAtomicUpdates, TestSubQueryTransformer, ZkCLITest, DistributedFacetPivotLongTailTest, TestPushWriter, TestQueryWrapperFilter, OverseerModifyCollectionTest, TestManagedResource, TestJettySolrRunner, ZkSolrClientTest, TriggerIntegrationTest, HdfsChaosMonkeyNothingIsSafeTest, CreateCollectionCleanupTest, PolyFieldTest, TestCollationField, CollectionTooManyReplicasTest, SolrGraphiteReporterTest, TestConfigSetsAPI, DocumentAnalysisRequestHandlerTest, TestUseDocValuesAsStored, SolrSlf4jReporterTest, TestMultiValuedNumericRangeQuery, OpenCloseCoreStressTest, BasicAuthIntegrationTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [288/765 (2!)] on J1 in 110.02s, 19 tests, 1 error <<< FAILURES!
[...truncated 45452 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build #
21141 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21141/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index ٠ out-of-bounds for length ٠
Stack Trace:
java.lang.IndexOutOfBoundsException: Index ٠ out-of-bounds for length ٠
at java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64)
at java.base/jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70)
at java.base/jdk.internal.util.Preconditions.checkIndex(Preconditions.java:248)
at java.base/java.util.Objects.checkIndex(Objects.java:372)
at java.base/java.util.ArrayList.get(ArrayList.java:440)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12693 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 1501602 INFO (SUITE-TestReplicationHandler-seed#[47039F77D1976D45]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/init-core-data-001
[junit4] 2> 1501603 WARN (SUITE-TestReplicationHandler-seed#[47039F77D1976D45]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=123 numCloses=123
[junit4] 2> 1501603 INFO (SUITE-TestReplicationHandler-seed#[47039F77D1976D45]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1501604 INFO (SUITE-TestReplicationHandler-seed#[47039F77D1976D45]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
[junit4] 2> 1501605 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestIndexFetchWithMasterUrl
[junit4] 2> 1501605 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/collection1
[junit4] 2> 1501608 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1501610 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34ec8fa8{/solr,null,AVAILABLE}
[junit4] 2> 1501610 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@19a43dde{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/collection1/data, hostPort=36461}
[junit4] 2> 1501611 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1501611 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T18:18:32.648830Z
[junit4] 2> 1501612 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/solr.xml
[junit4] 2> 1501626 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1501626 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1501627 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1501661 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501669 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501669 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501671 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/.
[junit4] 2> 1501671 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1501671 INFO (coreLoadExecutor-5169-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1501677 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1501683 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1501684 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1501684 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 1501684 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501685 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1501685 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/./collection1/data/]
[junit4] 2> 1501686 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1501723 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1501723 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1501724 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@a5ee086
[junit4] 2> 1501724 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@44fa1279[collection1] main]
[junit4] 2> 1501724 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-001/collection1/conf
[junit4] 2> 1501725 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1501725 INFO (coreLoadExecutor-5169-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1501726 INFO (searcherExecutor-5170-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@44fa1279[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1501726 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1
[junit4] 2> 1501728 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@152df4aa{/solr,null,AVAILABLE}
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a0a83dc{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1/data, hostPort=42777}
[junit4] 2> 1501729 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1501729 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T18:18:32.766939Z
[junit4] 2> 1501730 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/solr.xml
[junit4] 2> 1501732 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1501732 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1501733 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1501775 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501788 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501788 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501790 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/.
[junit4] 2> 1501791 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1501791 INFO (coreLoadExecutor-5179-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1501795 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1501799 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1501799 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1501799 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 1501800 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501800 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1501800 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/./collection1/data/]
[junit4] 2> 1501801 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1501828 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1501828 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1501829 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@76da4560
[junit4] 2> 1501829 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@11946145[collection1] main]
[junit4] 2> 1501830 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1/conf
[junit4] 2> 1501831 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 1501831 INFO (coreLoadExecutor-5179-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1501832 INFO (searcherExecutor-5180-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@11946145[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1501833 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1501833 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44dbf9ad commitCommandVersion:0
[junit4] 2> 1501833 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7a0a83dc{HTTP/1.1,[http/1.1]}{127.0.0.1:?}
[junit4] 2> 1501834 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=753586573
[junit4] 2> 1501834 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1501834 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@56fe95f0: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@764f64f7
[junit4] 2> 1501835 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f24754a[collection1] main]
[junit4] 2> 1501835 INFO (indexFetcher-5184-thread-1) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1501836 INFO (searcherExecutor-5180-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2f24754a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1501839 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1501839 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@437237ec: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5d2b6ea5
[junit4] 2> 1501843 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1501843 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@75d6dcfc: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1649cfcc
[junit4] 2> 1501843 INFO (coreCloseExecutor-5185-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5ca17a64
[junit4] 2> 1501843 INFO (coreCloseExecutor-5185-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1554086500
[junit4] 2> 1501843 INFO (coreCloseExecutor-5185-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@13577408: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@4b50fc68
[junit4] 2> 1501850 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@152df4aa{/solr,null,UNAVAILABLE}
[junit4] 2> 1501852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1501852 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3525bb77{/solr,null,AVAILABLE}
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@523124c4{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.e.j.s.Server Started @???????ms
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1/data, hostPort=36789}
[junit4] 2> 1501853 ERROR (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T18:18:32.890527Z
[junit4] 2> 1501853 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/solr.xml
[junit4] 2> 1501856 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1501856 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1501857 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1501894 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501902 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501902 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501903 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/.
[junit4] 2> 1501903 INFO (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[47039F77D1976D45]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1501904 INFO (coreLoadExecutor-5192-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1501909 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1501914 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1501915 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1501915 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 1501916 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df57675
[junit4] 2> 1501916 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1501916 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/./collection1/data/]
[junit4] 2> 1501917 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1501944 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1501944 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1501944 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5a11efc6
[junit4] 2> 1501944 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5106edfc[collection1] main]
[junit4] 2> 1501945 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001/solr-instance-002/collection1/conf
[junit4] 2> 1501945 INFO (coreLoadExecutor-5192-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1501946 INFO (searcherExecutor-5193-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5106edfc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1502447 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1502447 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 1502447 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1502448 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 1502448 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1502448 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@54b2f750 commitCommandVersion:0
[junit4] 2> 1502448 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b48198d[collection1] main]
[junit4] 2> 1502449 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1502450 INFO (searcherExecutor-5193-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1b48198d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1502450 INFO (qtp1797050331-13605) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 2
[junit4] 2> 1502451 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 1502451 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 1502451 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 1502452 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 1502452 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 1502452 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 1502452 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 1502453 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 1502454 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 1502455 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 1502455 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 1502455 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 1502455 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 1502455 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
[junit4] 2> 1502456 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 1502456 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 1502456 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 1502456 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 1502456 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 1502457 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
[junit4] 2> 1502458 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
[junit4] 2> 1502459 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
[junit4] 2> 1502459 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 0
[junit4] 2> 1502459 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
[junit4] 2> 1502459 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
[junit4] 2> 1502459 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
[junit4] 2> 1502460 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
[junit4] 2> 1502460 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
[junit4] 2> 1502460 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
[junit4] 2> 1502460 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
[junit4] 2> 1502460 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 0
[junit4] 2> 1502461 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
[junit4] 2> 1502461 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
[junit4] 2> 1502461 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
[junit4] 2> 1502461 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 0
[junit4] 2> 1502461 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
[junit4] 2> 1502462 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
[junit4] 2> 1502462 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0
[junit4] 2> 1502462 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
[junit4] 2> 1502462 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
[junit4] 2> 1502462 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
[junit4] 2> 1502463 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
[junit4] 2> 1502464 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
[junit4] 2> 1502465 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 0
[junit4] 2> 1502466 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
[junit4] 2> 1502467 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
[junit4] 2> 1502468 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
[junit4] 2> 1502469 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
[junit4] 2> 1502470 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
[junit4] 2> 1502471 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 0
[junit4] 2> 1502472 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
[junit4] 2> 1502473 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
[junit4] 2> 1502474 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 0
[junit4] 2> 1502475 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
[junit4] 2> 1502476 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
[junit4] 2> 1502477 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
[junit4] 2> 1502477 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
[junit4] 2> 1502477 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
[junit4] 2> 1502477 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
[junit4] 2> 1502477 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
[junit4] 2> 1502478 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
[junit4] 2> 1502479 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
[junit4] 2> 1502479 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
[junit4] 2> 1502479 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
[junit4] 2> 1502479 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
[junit4] 2> 1502479 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
[junit4] 2> 1502480 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
[junit4] 2> 1502481 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
[junit4] 2> 1502482 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
[junit4] 2> 1502482 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
[junit4] 2> 1502482 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
[junit4] 2> 1502482 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
[junit4] 2> 1502483 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
[junit4] 2> 1502483 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
[junit4] 2> 1502483 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
[junit4] 2> 1502483 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
[junit4] 2> 1502483 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
[junit4] 2> 1502484 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
[junit4] 2> 1502484 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
[junit4] 2> 1502484 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
[junit4] 2> 1502484 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
[junit4] 2> 1502484 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[202]} 0 0
[junit4] 2> 1502485 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[203]} 0 0
[junit4] 2> 1502486 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[204]} 0 0
[junit4] 2> 1502486 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[205]} 0 0
[junit4] 2> 1502486 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[206]} 0 0
[junit4] 2> 1502486 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[207]} 0 0
[junit4] 2> 1502486 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[208]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[209]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[210]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[211]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[212]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[213]} 0 0
[junit4] 2> 1502487 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[214]} 0 0
[junit4] 2> 1502488 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[215]} 0 0
[junit4] 2> 1502488 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[216]} 0 0
[junit4] 2> 1502488 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[217]} 0 0
[junit4] 2> 1502488 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[218]} 0 0
[junit4] 2> 1502488 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[219]} 0 0
[junit4] 2> 1502489 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[220]} 0 0
[junit4] 2> 1502489 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[221]} 0 0
[junit4] 2> 1502489 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[222]} 0 0
[junit4] 2> 1502489 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[223]} 0 0
[junit4] 2> 1502489 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[224]} 0 0
[junit4] 2> 1502490 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[225]} 0 0
[junit4] 2> 1502490 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[226]} 0 0
[junit4] 2> 1502490 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[227]} 0 0
[junit4] 2> 1502490 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[228]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[229]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[230]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[231]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[232]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[233]} 0 0
[junit4] 2> 1502491 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[234]} 0 0
[junit4] 2> 1502492 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[235]} 0 0
[junit4] 2> 1502492 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[236]} 0 0
[junit4] 2> 1502492 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[237]} 0 0
[junit4] 2> 1502492 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[238]} 0 0
[junit4] 2> 1502492 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[239]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[240]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[241]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[242]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[243]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[244]} 0 0
[junit4] 2> 1502493 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[245]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[246]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[247]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[248]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[249]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[250]} 0 0
[junit4] 2> 1502494 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[251]} 0 0
[junit4] 2> 1502495 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[252]} 0 0
[junit4] 2> 1502495 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[253]} 0 0
[junit4] 2> 1502495 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[254]} 0 0
[junit4] 2> 1502495 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[255]} 0 0
[junit4] 2> 1502495 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[256]} 0 0
[junit4] 2> 1502496 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[257]} 0 0
[junit4] 2> 1502496 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[258]} 0 0
[junit4] 2> 1502496 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[259]} 0 0
[junit4] 2> 1502496 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[260]} 0 0
[junit4] 2> 1502496 INFO (qtp1808308503-13566) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[261]} 0 0
[junit4] 2> 1502497 INFO (qtp1808308503-13561) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[262]} 0 0
[junit4] 2> 1502497 INFO (qtp1808308503-13562) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[263]} 0 0
[junit4] 2> 1502497 INFO (qtp1808308503-13568) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[264]} 0 0
[j
[...truncated too long message...]
dler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.SolrTestCaseJ4 ###Ending doTestRepeater
[junit4] 2> 1618032 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4b2a33f5{HTTP/1.1,[http/1.1]}{127.0.0.1:?}
[junit4] 2> 1618032 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2015081097
[junit4] 2> 1618032 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1618032 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4be0aecb: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@47bf6fcd
[junit4] 2> 1618033 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1618033 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1053b8a: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5d2b6ea5
[junit4] 2> 1618033 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1618033 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a1273df: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1649cfcc
[junit4] 2> 1618034 INFO (coreCloseExecutor-5857-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@41a9918b
[junit4] 2> 1618034 INFO (coreCloseExecutor-5857-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1101631883
[junit4] 2> 1618034 INFO (coreCloseExecutor-5857-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@544fce80: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@61a82d68
[junit4] 2> 1618035 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@55cbf851{/solr,null,UNAVAILABLE}
[junit4] 2> 1618036 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6e1ed06a{HTTP/1.1,[http/1.1]}{127.0.0.1:?}
[junit4] 2> 1618036 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2133734016
[junit4] 2> 1618036 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1618036 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41fd2a19: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@7ce15bfc
[junit4] 2> 1618037 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1618037 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1acef05c: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5d2b6ea5
[junit4] 2> 1618038 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1618038 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@471d14e: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1649cfcc
[junit4] 2> 1618038 INFO (coreCloseExecutor-5859-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4c4fd9aa
[junit4] 2> 1618038 INFO (coreCloseExecutor-5859-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1280301482
[junit4] 2> 1618038 INFO (coreCloseExecutor-5859-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@663c0c31: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1e77e94d
[junit4] 2> 1618040 INFO (TEST-TestReplicationHandler.doTestRepeater-seed#[47039F77D1976D45]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@14cf2e2b{/solr,null,UNAVAILABLE}
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_47039F77D1976D45-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {name=Lucene50(blocksize=128), id=Lucene50(blocksize=128), newname=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1085, maxMBSortInHeap=5.73957742559892, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@326e65f5), locale=ar-SD, timezone=America/Managua
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=135578720,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [DistributedIntervalFacetingTest, RegexBoostProcessorTest, BigEndianAscendingWordDeserializerTest, TestLegacyFieldReuse, SolrIndexSplitterTest, ConvertedLegacyTest, SuggestComponentContextFilterQueryTest, ShardRoutingCustomTest, SolrSlf4jReporterTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CollectionTooManyReplicasTest, RemoteQueryErrorTest, DistribDocExpirationUpdateProcessorTest, SampleTest, ChaosMonkeySafeLeaderTest, TestRemoteStreaming, DebugComponentTest, TestOrdValues, DistributedExpandComponentTest, OutputWriterTest, TestNumericTerms32, CloudExitableDirectoryReaderTest, HdfsLockFactoryTest, RestartWhileUpdatingTest, TestJmxIntegration, PolyFieldTest, TestSolr4Spatial, TermVectorComponentDistributedTest, TestDynamicFieldResource, TestAddFieldRealTimeGet, DOMUtilTest, PathHierarchyTokenizerFactoryTest, TestUnifiedSolrHighlighter, PropertiesRequestHandlerTest, CdcrVersionReplicationTest, TestBulkSchemaAPI, TestManagedResource, TestDocSet, TestTlogReplica, DistributedFacetPivotLongTailTest, RequestHandlersTest, ShowFileRequestHandlerTest, TestMissingGroups, TestJettySolrRunner, SuggesterTSTTest, TestDocumentBuilder, TestQueryWrapperFilter, SearchRateTriggerTest, SolrRequestParserTest, TestCloudInspectUtil, TestConfigSetsAPI, CloudMLTQParserTest, TestLazyCores, TestSerializedLuceneMatchVersion, SpatialRPTFieldTypeTest, TestSolr4Spatial2, TestDownShardTolerantSearch, TestFieldCacheReopen, LeaderInitiatedRecoveryOnShardRestartTest, HdfsTlogReplayBufferedWhileIndexingTest, DocValuesMultiTest, ExplicitHLLTest, SuggesterFSTTest, TestAnalyzeInfixSuggestions, SolrXmlInZkTest, QueryResultKeyTest, TestSystemCollAutoCreate, ConcurrentDeleteAndCreateCollectionTest, PrimUtilsTest, ReplicaListTransformerTest, TestCorePropertiesReload, DistributedFacetPivotWhiteBoxTest, TestCollationField, TestXIncludeConfig, CoreMergeIndexesAdminHandlerTest, TestDistribStateManager, TestStressCloudBlindAtomicUpdates, OpenExchangeRatesOrgProviderTest, BinaryUpdateRequestHandlerTest, BooleanFieldTest, TestGeoJSONResponseWriter, AutoscalingHistoryHandlerTest, LeaderFailoverAfterPartitionTest, SearchHandlerTest, TestEmbeddedSolrServerAdminHandler, HighlighterConfigTest, StressHdfsTest, TestSurroundQueryParser, TestStandardQParsers, TestRebalanceLeaders, DeleteLastCustomShardedReplicaTest, TestTestInjection, PreAnalyzedFieldTest, TestUtilizeNode, BlockDirectoryTest, TestXmlQParser, SolrIndexConfigTest, CollectionsAPIDistributedZkTest, DistanceUnitsTest, SolrMetricReporterTest, TestFaceting, TestScoreJoinQPNoScore, TestWriterPerf, TestInPlaceUpdatesDistrib, TestSchemaResource, SaslZkACLProviderTest, TestReRankQParserPlugin, TestCursorMarkWithoutUniqueKey, TriggerIntegrationTest, QueryEqualityTest, TestMacros, TestFieldCacheVsDocValues, AssignTest, TestPseudoReturnFields, ShardRoutingTest, SignatureUpdateProcessorFactoryTest, AddReplicaTest, TestLeaderElectionWithEmptyReplica, CdcrReplicationDistributedZkTest, BlockJoinFacetDistribTest, TestSubQueryTransformer, TestSimpleTextCodec, NotRequiredUniqueKeyTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler]
[junit4] Completed [290/765 (1!)] on J1 in 116.45s, 16 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 42340 lines...]
[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build #
21140 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21140/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple
Error Message:
IOException occured when talking to server at: http://127.0.0.1:36613/solr
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:36613/solr
at __randomizedtesting.SeedInfo.seed([6038A8A2EC64B900:588B8C5CCB976DD1]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple(AutoAddReplicasPlanActionTest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:36613 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 48 more
Build Log:
[...truncated 12021 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/init-core-data-001
[junit4] 2> 442195 WARN (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 442195 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 442196 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 442196 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 442196 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001
[junit4] 2> 442196 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 442196 INFO (Thread-769) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 442196 INFO (Thread-769) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 442197 ERROR (Thread-769) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 442296 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:45509
[junit4] 2> 442299 INFO (zkConnectionManagerCallback-736-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442303 INFO (jetty-launcher-733-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 442303 INFO (jetty-launcher-733-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 442303 INFO (jetty-launcher-733-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 442312 INFO (jetty-launcher-733-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@11bcf5a{/solr,null,AVAILABLE}
[junit4] 2> 442312 INFO (jetty-launcher-733-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5e0a54{/solr,null,AVAILABLE}
[junit4] 2> 442312 INFO (jetty-launcher-733-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1331d8a{/solr,null,AVAILABLE}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1e71aec{HTTP/1.1,[http/1.1]}{127.0.0.1:45559}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1fc6acc{HTTP/1.1,[http/1.1]}{127.0.0.1:36613}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.e.j.s.Server Started @443780ms
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.e.j.s.Server Started @443780ms
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45559}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36613}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@16deea6{HTTP/1.1,[http/1.1]}{127.0.0.1:40675}
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-2) [ ] o.e.j.s.Server Started @443780ms
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40675}
[junit4] 2> 442316 ERROR (jetty-launcher-733-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 442316 ERROR (jetty-launcher-733-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T14:58:27.928Z
[junit4] 2> 442316 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T14:58:27.928Z
[junit4] 2> 442316 ERROR (jetty-launcher-733-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 442317 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 442317 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 442317 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 442317 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T14:58:27.929Z
[junit4] 2> 442325 INFO (zkConnectionManagerCallback-738-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442325 INFO (zkConnectionManagerCallback-742-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442325 INFO (zkConnectionManagerCallback-740-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442325 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 442325 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 442327 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 442342 INFO (jetty-launcher-733-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45509/solr
[junit4] 2> 442342 INFO (jetty-launcher-733-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45509/solr
[junit4] 2> 442342 INFO (jetty-launcher-733-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45509/solr
[junit4] 2> 442343 INFO (zkConnectionManagerCallback-749-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442343 INFO (zkConnectionManagerCallback-752-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442343 INFO (zkConnectionManagerCallback-754-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442344 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608e2e9d610005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 442348 INFO (zkConnectionManagerCallback-757-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442349 INFO (zkConnectionManagerCallback-758-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442349 INFO (zkConnectionManagerCallback-760-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442372 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 442372 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40675_solr
[junit4] 2> 442373 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.c.Overseer Overseer (id=99235522662170631-127.0.0.1:40675_solr-n_0000000000) starting
[junit4] 2> 442388 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40675_solr
[junit4] 2> 442400 INFO (zkCallback-755-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 442418 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 442419 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 442420 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45559_solr
[junit4] 2> 442421 INFO (zkCallback-755-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 442424 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 442424 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 442425 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 442426 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36613_solr
[junit4] 2> 442427 INFO (zkCallback-755-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 442440 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 442442 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 442556 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442558 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442562 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442562 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442563 INFO (jetty-launcher-733-thread-3) [n:127.0.0.1:36613_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node3/.
[junit4] 2> 442563 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442563 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442564 INFO (jetty-launcher-733-thread-2) [n:127.0.0.1:40675_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/.
[junit4] 2> 442604 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45559.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442609 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45559.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442609 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45559.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 442610 INFO (jetty-launcher-733-thread-1) [n:127.0.0.1:45559_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node1/.
[junit4] 2> 442630 INFO (zkConnectionManagerCallback-768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442632 INFO (zkConnectionManagerCallback-772-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 442633 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 442633 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45509/solr ready
[junit4] 2> 442644 INFO (TEST-AutoAddReplicasPlanActionTest.testSimple-seed#[6038A8A2EC64B900]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 442645 INFO (qtp21386723-3655) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:36613_solr,127.0.0.1:40675_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 442646 INFO (OverseerThreadFactory-1689-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 442752 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40675/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 442754 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36613/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 442755 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40675/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 442757 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36613/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 442959 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 442959 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 442959 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 442960 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 442960 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 442960 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 443064 INFO (zkCallback-755-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 443064 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 443969 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 443970 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 443986 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 443986 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 443986 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 443987 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 443987 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 443987 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 443987 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 443997 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 443997 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 443997 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 443997 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 443997 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/testSimple1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/./testSimple1_shard1_replica_n1/data/]
[junit4] 2> 443997 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node3/testSimple1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node3/./testSimple1_shard1_replica_n2/data/]
[junit4] 2> 443997 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 444005 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 444005 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 444006 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 444006 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 444006 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 444007 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 444007 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node3/testSimple1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node3/./testSimple1_shard2_replica_n6/data/]
[junit4] 2> 444007 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 444007 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 444007 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 444007 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 444007 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/testSimple1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/./testSimple1_shard2_replica_n4/data/]
[junit4] 2> 444049 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 444049 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 444050 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 444050 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 444052 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@10b7ee1[testSimple1_shard1_replica_n1] main]
[junit4] 2> 444052 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 444052 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 444053 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 444053 INFO (searcherExecutor-1696-thread-1-processing-n:127.0.0.1:40675_solr x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@10b7ee1[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 444053 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768364540887040
[junit4] 2> 444056 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 444058 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 444058 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 444058 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 444058 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 444059 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 444059 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 444059 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ca6812[testSimple1_shard2_replica_n4] main]
[junit4] 2> 444060 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 444060 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 444060 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 444060 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 444060 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 444060 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 444060 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 444061 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 444061 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 444061 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d13af7[testSimple1_shard2_replica_n6] main]
[junit4] 2> 444061 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 444061 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 444061 INFO (searcherExecutor-1699-thread-1-processing-n:127.0.0.1:40675_solr x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@1ca6812[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 444061 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768364549275648
[junit4] 2> 444062 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@17c656b[testSimple1_shard1_replica_n2] main]
[junit4] 2> 444062 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 444062 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 444062 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 444062 INFO (searcherExecutor-1698-thread-1-processing-n:127.0.0.1:36613_solr x:testSimple1_shard2_replica_n6 s:shard2 c:testSimple1 r:core_node8) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher Searcher@1d13af7[testSimple1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 444062 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768364550324224
[junit4] 2> 444063 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 444063 INFO (searcherExecutor-1697-thread-1-processing-n:127.0.0.1:36613_solr x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@17c656b[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 444064 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768364552421376
[junit4] 2> 444064 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 444064 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 444064 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40675/solr/testSimple1_shard2_replica_n4/
[junit4] 2> 444064 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:40675/solr START replicas=[http://127.0.0.1:36613/solr/testSimple1_shard2_replica_n6/] nUpdates=100
[junit4] 2> 444066 INFO (qtp21386723-3651) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.S.Request [testSimple1_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444165 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444165 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444365 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:40675/solr DONE. We have no versions. sync failed.
[junit4] 2> 444365 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 444365 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 444365 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 444369 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40675/solr/testSimple1_shard2_replica_n4/ shard2
[junit4] 2> 444470 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444470 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444519 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 444527 INFO (qtp13668122-3657) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1567
[junit4] 2> 444557 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 444557 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 444557 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40675/solr/testSimple1_shard1_replica_n1/
[junit4] 2> 444557 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:40675/solr START replicas=[http://127.0.0.1:36613/solr/testSimple1_shard1_replica_n2/] nUpdates=100
[junit4] 2> 444558 INFO (qtp21386723-3731) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.S.Request [testSimple1_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444621 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444621 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444857 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:40675/solr DONE. We have no versions. sync failed.
[junit4] 2> 444858 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 444858 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 444858 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 444863 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40675/solr/testSimple1_shard1_replica_n1/ shard1
[junit4] 2> 444964 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 444964 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 445014 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 445023 INFO (qtp13668122-3653) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2063
[junit4] 2> 445066 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2106
[junit4] 2> 445067 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2107
[junit4] 2> 445072 INFO (qtp21386723-3655) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 445168 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 445168 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 446072 INFO (qtp21386723-3655) [n:127.0.0.1:36613_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:36613_solr,127.0.0.1:40675_solr&wt=javabin&version=2} status=0 QTime=3426
[junit4] 2> 446072 INFO (qtp21386723-3658) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40675_solr,127.0.0.1:45559_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 446074 INFO (OverseerThreadFactory-1689-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple2
[junit4] 2> 446074 INFO (OverseerCollectionConfigSetProcessor-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 446278 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45559/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 446278 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40675/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 446480 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 446480 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 446480 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 446582 INFO (zkCallback-755-thread-1-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 446582 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 446582 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 446583 INFO (zkCallback-756-thread-2-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447512 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 447512 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 447516 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n1] Schema name=minimal
[junit4] 2> 447516 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n2] Schema name=minimal
[junit4] 2> 447518 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 447518 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 447518 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from collection testSimple2, trusted=true
[junit4] 2> 447518 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from collection testSimple2, trusted=true
[junit4] 2> 447519 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40675.solr.core.testSimple2.shard1.replica_n2' (registry 'solr.core.testSimple2.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 447519 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45559.solr.core.testSimple2.shard1.replica_n1' (registry 'solr.core.testSimple2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 447519 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 447519 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 447519 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node1/testSimple2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node1/./testSimple2_shard1_replica_n1/data/]
[junit4] 2> 447519 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/testSimple2_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001/tempDir-001/node2/./testSimple2_shard1_replica_n2/data/]
[junit4] 2> 447571 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 447571 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 447571 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 447571 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 447571 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 447571 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 447571 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 447571 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 447572 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3fbc3b[testSimple2_shard1_replica_n1] main]
[junit4] 2> 447572 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c333c4[testSimple2_shard1_replica_n2] main]
[junit4] 2> 447573 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 447573 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 447573 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 447573 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 447574 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 447574 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 447574 INFO (searcherExecutor-1717-thread-1-processing-n:127.0.0.1:40675_solr x:testSimple2_shard1_replica_n2 s:shard1 c:testSimple2 r:core_node4) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher Searcher@1c333c4[testSimple2_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 447574 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768368232923136
[junit4] 2> 447575 INFO (searcherExecutor-1716-thread-1-processing-n:127.0.0.1:45559_solr x:testSimple2_shard1_replica_n1 s:shard1 c:testSimple2 r:core_node3) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher Searcher@3fbc3b[testSimple2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 447575 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587768368233971712
[junit4] 2> 447577 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 447577 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 447577 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40675/solr/testSimple2_shard1_replica_n2/
[junit4] 2> 447577 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n2 url=http://127.0.0.1:40675/solr START replicas=[http://127.0.0.1:45559/solr/testSimple2_shard1_replica_n1/] nUpdates=100
[junit4] 2> 447579 INFO (qtp15202909-3659) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.c.S.Request [testSimple2_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 447678 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447678 INFO (zkCallback-756-thread-2-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447678 INFO (zkCallback-755-thread-3-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447678 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447878 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n2 url=http://127.0.0.1:40675/solr DONE. We have no versions. sync failed.
[junit4] 2> 447878 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 447878 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 447878 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 447879 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40675/solr/testSimple2_shard1_replica_n2/ shard1
[junit4] 2> 447980 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447980 INFO (zkCallback-756-thread-2-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447980 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 447980 INFO (zkCallback-755-thread-3-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448030 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 448031 INFO (qtp13668122-3641) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1551
[junit4] 2> 448131 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448131 INFO (zkCallback-755-thread-3-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448131 INFO (zkCallback-756-thread-2-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448131 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448579 INFO (qtp15202909-3652) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=1&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2098
[junit4] 2> 448580 INFO (qtp21386723-3658) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 448679 INFO (zkCallback-755-thread-2-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448679 INFO (zkCallback-755-thread-3-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448679 INFO (zkCallback-756-thread-1-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 448679 INFO (zkCallback-756-thread-2-processing-n:127.0.0.1:45559_solr) [n:127.0.0.1:45559_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 449580 INFO (qtp21386723-3658) [n:127.0.0.1:36613_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40675_solr,127.0.0.1:45559_solr&wt=javabin&version=2} status=0 QTime=3508
[junit4] 2> 449581 INFO (qtp21386723-3745) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&maxShardsPerNode=3&autoAddReplicas=false&name=testSimple3&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=127.0.0.1:36613_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 449582 INFO (OverseerThreadFactory-1689-thread-3-processing-n:127.0.0.1:40675_solr) [n:127.0.0.1:40675_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple3
[junit4] 2> 449582 INFO (OverseerCollectionConfigSetProcessor-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 449786 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple3_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36613/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 449786 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple3_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36613/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 449787 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"testSimple3_shard3_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36613/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 449988 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple3_shard2_replica_n2&action=CREATE&numShards=3&collection=testSimple3&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 449989 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple3_shard1_replica_n1&action=CREATE&numShards=3&collection=testSimple3&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 449989 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=testSimple3_shard3_replica_n4&action=CREATE&numShards=3&collection=testSimple3&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 450096 INFO (zkCallback-759-thread-1-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple3/state.json] for collection [testSimple3] has occurred - updating... (live nodes size: [3])
[junit4] 2> 450096 INFO (zkCallback-759-thread-2-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple3/state.json] for collection [testSimple3] has occurred - updating... (live nodes size: [3])
[junit4] 2> 451020 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 451021 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 451021 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 451026 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.s.IndexSchema [testSimple3_shard2_replica_n2] Schema name=minimal
[junit4] 2> 451026 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.s.IndexSchema [testSimple3_shard3_replica_n4] Schema name=minimal
[junit4] 2> 451026 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple3_shard1_replica_n1] Schema name=minimal
[junit4] 2> 451041 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 451041 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 451041 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple3_shard1_replica_n1' using configuration from collection testSimple3, trusted=true
[junit4] 2> 451041 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple3_shard3_replica_n4' using configuration from collection testSimple3, trusted=true
[junit4] 2> 451041 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 451041 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple3_shard2_replica_n2' using configuration from collection testSimple3, trusted=true
[junit4] 2> 451041 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.core.testSimple3.shard2.replica_n2' (registry 'solr.core.testSimple3.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 451041 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.core.testSimple3.shard1.replica_n1' (registry 'solr.core.testSimple3.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 451041 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36613.solr.core.testSimple3.shard3.replica_n4' (registry 'solr.core.testSimple3.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fa11bd
[junit4] 2> 451041 INFO (qtp21386723-3662) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 451041 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 451041 INFO (qtp21386723-3644) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 451041 INFO (qtp21386723-3640) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.c.SolrCore [[testSimple3_shard3_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspac
[...truncated too long message...]
[junit4] 2> 454767 INFO (coreCloseExecutor-1776-thread-1) [n:127.0.0.1:45559_solr c:testSimple2 s:shard1 r:core_node3 x:testSimple2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=32805346
[junit4] 2> 454769 INFO (jetty-closer-734-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5e0a54{/solr,null,UNAVAILABLE}
[junit4] 2> 454772 INFO (coreCloseExecutor-1775-thread-3) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple3.shard1.replica_n1, tag=3667624
[junit4] 2> 454772 INFO (coreCloseExecutor-1775-thread-3) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@107e6f0: rootName = solr_36613, domain = solr.core.testSimple3.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testSimple3.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@69fc3a
[junit4] 2> 454775 INFO (coreCloseExecutor-1774-thread-1) [n:127.0.0.1:40675_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=7622307
[junit4] 2> 454775 INFO (coreCloseExecutor-1774-thread-3) [n:127.0.0.1:40675_solr c:testSimple2 s:shard1 r:core_node4 x:testSimple2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=2473373
[junit4] 2> 454775 INFO (coreCloseExecutor-1774-thread-2) [n:127.0.0.1:40675_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=3358960
[junit4] 2> 454778 INFO (coreCloseExecutor-1775-thread-4) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple3.shard3.replica_n4, tag=29318238
[junit4] 2> 454778 INFO (coreCloseExecutor-1775-thread-4) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12d0022: rootName = solr_36613, domain = solr.core.testSimple3.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.testSimple3.shard3.replica_n4 / com.codahale.metrics.MetricRegistry@fb88a1
[junit4] 2> 454778 INFO (jetty-closer-734-thread-2) [ ] o.a.s.c.Overseer Overseer (id=99235522662170631-127.0.0.1:40675_solr-n_0000000000) closing
[junit4] 2> 454778 INFO (OverseerStateUpdate-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40675_solr
[junit4] 2> 454778 WARN (OverseerAutoScalingTriggerThread-99235522662170631-127.0.0.1:40675_solr-n_0000000000) [n:127.0.0.1:40675_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 454779 INFO (zkCallback-779-thread-3-processing-n:127.0.0.1:36613_solr) [n:127.0.0.1:36613_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36613_solr
[junit4] 2> 454779 INFO (jetty-closer-734-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@11bcf5a{/solr,null,UNAVAILABLE}
[junit4] 2> 454786 INFO (coreCloseExecutor-1775-thread-4) [n:127.0.0.1:36613_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard3.leader, tag=29318238
[junit4] 2> 454786 INFO (coreCloseExecutor-1775-thread-5) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple3.shard2.replica_n2, tag=17839657
[junit4] 2> 454786 INFO (coreCloseExecutor-1775-thread-5) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a7d029: rootName = solr_36613, domain = solr.core.testSimple3.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.testSimple3.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@9f07eb
[junit4] 2> 454791 INFO (coreCloseExecutor-1775-thread-1) [n:127.0.0.1:36613_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=31843624
[junit4] 2> 454792 INFO (coreCloseExecutor-1775-thread-2) [n:127.0.0.1:36613_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=28525578
[junit4] 2> 454792 INFO (coreCloseExecutor-1775-thread-3) [n:127.0.0.1:36613_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard1.leader, tag=3667624
[junit4] 2> 454793 INFO (coreCloseExecutor-1775-thread-5) [n:127.0.0.1:36613_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard2.leader, tag=17839657
[junit4] 2> 454797 INFO (jetty-closer-734-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c46ecc{/solr,null,UNAVAILABLE}
[junit4] 2> 454797 ERROR (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 454797 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[6038A8A2EC64B900]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45509 45509
[junit4] 2> 454956 INFO (Thread-769) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45509 45509
[junit4] 2> 454957 WARN (Thread-769) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 14 /solr/collections/testSimple2/state.json
[junit4] 2> 8 /solr/collections/testSimple3/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 3 /solr/collections/testSimple1/state.json
[junit4] 2> 2 /solr/overseer_elect/election/99235522662170632-127.0.0.1:45559_solr-n_0000000001
[junit4] 2> 2 /solr/collections/testSimple1/leader_elect/shard1/election/99235522662170631-core_node3-n_0000000000
[junit4] 2> 2 /solr/collections/testSimple1/leader_elect/shard2/election/99235522662170631-core_node7-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/99235522662170631-127.0.0.1:40675_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_6038A8A2EC64B900-001
[junit4] 2> Dec 25, 2017 2:58:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1105, maxMBSortInHeap=5.816939415650226, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@f4fce1), locale=ar-LB, timezone=Europe/Dublin
[junit4] 2> NOTE: Linux 4.10.0-40-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=30712248,total=233689088
[junit4] 2> NOTE: All tests run in this JVM: [TestSolr4Spatial2, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, TestAnalyzedSuggestions, TestStressLucene, GraphQueryTest, TestCollationField, VMParamsZkACLAndCredentialsProvidersTest, DebugComponentTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, RemoteQueryErrorTest, SOLR749Test, AddReplicaTest, TestCorePropertiesReload, TestTlogReplica, TestCloudInspectUtil, TestConfigsApi, ExecutePlanActionTest, MetricTriggerTest, CdcrReplicationDistributedZkTest, TestDistribStateManager, TestManagedSynonymFilterFactory, TestAddFieldRealTimeGet, TestInitQParser, TestStandardQParsers, TestInPlaceUpdatesDistrib, TestDFISimilarityFactory, BigEndianAscendingWordDeserializerTest, SolrGraphiteReporterTest, TestFastWriter, TestJsonFacetRefinement, TestPushWriter, ConcurrentDeleteAndCreateCollectionTest, HdfsLockFactoryTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, TestCryptoKeys, ShardRoutingCustomTest, DistributedFacetPivotLongTailTest, SearchHandlerTest, NotRequiredUniqueKeyTest, BooleanFieldTest, TestSQLHandlerNonCloud, TestBulkSchemaAPI, TestFastLRUCache, LeaderInitiatedRecoveryOnShardRestartTest, TestImplicitCoreProperties, AutoAddReplicasPlanActionTest]
[junit4] Completed [112/765 (1!)] on J1 in 13.27s, 1 test, 1 error <<< FAILURES!
[...truncated 46010 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build #
21139 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21139/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:38969/i_/zk/collMinRf_1x3
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:38969/i_/zk/collMinRf_1x3
at __randomizedtesting.SeedInfo.seed([D1D587E834EF82B4:5981B8329A13EF4C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.HttpPartitionTest.realTimeGetDocId(HttpPartitionTest.java:617)
at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:602)
at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:559)
at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:250)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 49 more
FAILED: org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData
Error Message:
Node watch should have fired!
Stack Trace:
java.lang.AssertionError: Node watch should have fired!
at __randomizedtesting.SeedInfo.seed([D1D587E834EF82B4:F74568BA606144BE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData(TestDistribStateManager.java:256)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12907 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/init-core-data-001
[junit4] 2> 1214889 WARN (SUITE-HttpPartitionTest-seed#[D1D587E834EF82B4]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 1214890 INFO (SUITE-HttpPartitionTest-seed#[D1D587E834EF82B4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1214891 INFO (SUITE-HttpPartitionTest-seed#[D1D587E834EF82B4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1214891 INFO (SUITE-HttpPartitionTest-seed#[D1D587E834EF82B4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1214891 INFO (SUITE-HttpPartitionTest-seed#[D1D587E834EF82B4]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /i_/zk
[junit4] 2> 1214894 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1214894 INFO (Thread-5338) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1214894 INFO (Thread-5338) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1214896 ERROR (Thread-5338) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1214995 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkTestServer start zk server on port:40901
[junit4] 2> 1214997 INFO (zkConnectionManagerCallback-1685-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1214999 INFO (zkConnectionManagerCallback-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215001 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1215001 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1215002 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1215002 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1215003 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1215003 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1215003 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1215004 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1215004 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1215004 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1215005 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1215005 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 1215055 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1215056 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5aaa46d1{/i_/zk,null,AVAILABLE}
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4aa47b81{HTTP/1.1,[http/1.1]}{127.0.0.1:45483}
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server Started @1217851ms
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/tempDir-001/control/data, hostContext=/i_/zk, hostPort=38969, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/control-001/cores}
[junit4] 2> 1215057 ERROR (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1215057 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T12:14:25.295Z
[junit4] 2> 1215058 INFO (zkConnectionManagerCallback-1689-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215059 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1215059 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/control-001/solr.xml
[junit4] 2> 1215061 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1215061 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1215062 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1215063 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40901/solr
[junit4] 2> 1215092 INFO (zkConnectionManagerCallback-1693-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215094 INFO (zkConnectionManagerCallback-1695-thread-1-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215139 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1215139 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38969_i_%2Fzk
[junit4] 2> 1215139 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.Overseer Overseer (id=99234877612556292-127.0.0.1:38969_i_%2Fzk-n_0000000000) starting
[junit4] 2> 1215150 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38969_i_%2Fzk
[junit4] 2> 1215154 INFO (zkCallback-1694-thread-1-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1215187 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1215192 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1215193 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1215193 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/control-001/cores
[junit4] 2> 1215205 INFO (zkConnectionManagerCallback-1701-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1215206 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1215206 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40901/solr ready
[junit4] 2> 1215206 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50992,localport=38969], receiveBufferSize:531000
[junit4] 2> 1215208 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45483,localport=45918], receiveBufferSize=530904
[junit4] 2> 1215210 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38969_i_%252Fzk&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1215214 INFO (OverseerThreadFactory-3458-thread-1-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1215316 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50996,localport=38969], receiveBufferSize:531000
[junit4] 2> 1215317 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45483,localport=45922], receiveBufferSize=530904
[junit4] 2> 1215323 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1215323 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1215426 INFO (zkCallback-1694-thread-1-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1216341 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1216352 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1216441 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1216448 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1216448 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1216448 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1216448 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1216449 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=58.3798828125, floorSegmentMB=0.9541015625, forceMergeDeletesPctAllowed=16.34364735226315, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.361549881501645
[junit4] 2> 1216451 WARN (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1216471 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1216471 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1216473 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1216473 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1216474 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.6708984375, floorSegmentMB=1.9189453125, forceMergeDeletesPctAllowed=13.068365973161654, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24920180078429485
[junit4] 2> 1216474 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@66410711[control_collection_shard1_replica_n1] main]
[junit4] 2> 1216474 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1216474 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1216475 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1216476 INFO (searcherExecutor-3461-thread-1-processing-n:127.0.0.1:38969_i_%2Fzk x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@66410711[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1216476 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587758043458699264
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38969/i_/zk/control_collection_shard1_replica_n1/
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:38969/i_/zk/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1216478 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1216479 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38969/i_/zk/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1216580 INFO (zkCallback-1694-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1216630 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1216637 INFO (qtp251598977-11923) [n:127.0.0.1:38969_i_%2Fzk c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1314
[junit4] 2> 1216639 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1216732 INFO (zkCallback-1694-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1217216 INFO (OverseerCollectionConfigSetProcessor-99234877612556292-127.0.0.1:38969_i_%2Fzk-n_0000000000) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1217639 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:38969_i_%252Fzk&wt=javabin&version=2} status=0 QTime=2429
[junit4] 2> 1217643 INFO (zkConnectionManagerCallback-1705-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217644 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1217644 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40901/solr ready
[junit4] 2> 1217644 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1217644 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=51040,localport=38969], receiveBufferSize:531000
[junit4] 2> 1217644 INFO (SocketProxy-Acceptor-38969) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45483,localport=45966], receiveBufferSize=530904
[junit4] 2> 1217645 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1217646 INFO (OverseerThreadFactory-3458-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1217646 WARN (OverseerThreadFactory-3458-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1217849 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1217849 INFO (qtp251598977-11921) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=203
[junit4] 2> 1217916 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001 of type TLOG
[junit4] 2> 1217916 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1217918 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3ebf23cc{/i_/zk,null,AVAILABLE}
[junit4] 2> 1217918 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@60d0eb39{HTTP/1.1,[http/1.1]}{127.0.0.1:46821}
[junit4] 2> 1217918 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server Started @1220713ms
[junit4] 2> 1217918 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/i_/zk, hostPort=33611, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001/cores}
[junit4] 2> 1217918 ERROR (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1217919 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1217919 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1217919 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1217919 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T12:14:28.157Z
[junit4] 2> 1217920 INFO (zkConnectionManagerCallback-1707-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217920 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1217920 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001/solr.xml
[junit4] 2> 1217922 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1217922 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1217923 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1217924 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40901/solr
[junit4] 2> 1217925 INFO (zkConnectionManagerCallback-1711-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217927 INFO (zkConnectionManagerCallback-1713-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1217928 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1217929 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1217930 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33611_i_%2Fzk
[junit4] 2> 1217933 INFO (zkCallback-1694-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1217937 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1217937 INFO (zkCallback-1704-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1217972 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1217978 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1217978 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1217979 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001/cores
[junit4] 2> 1217995 INFO (SocketProxy-Acceptor-33611) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=51438,localport=33611], receiveBufferSize:531000
[junit4] 2> 1217995 INFO (SocketProxy-Acceptor-33611) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=46821,localport=42704], receiveBufferSize=530904
[junit4] 2> 1217998 INFO (qtp1124687369-11976) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33611_i_%252Fzk&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1218000 INFO (OverseerCollectionConfigSetProcessor-99234877612556292-127.0.0.1:38969_i_%2Fzk-n_0000000000) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1218000 INFO (OverseerThreadFactory-3458-thread-3-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33611_i_%2Fzk for creating new replica
[junit4] 2> 1218001 INFO (SocketProxy-Acceptor-33611) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=51442,localport=33611], receiveBufferSize:531000
[junit4] 2> 1218005 INFO (SocketProxy-Acceptor-33611) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=46821,localport=42708], receiveBufferSize=530904
[junit4] 2> 1218005 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1218006 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1218108 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1219021 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1219028 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 1219100 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1219106 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 1219106 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1219106 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1219106 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 1219108 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=58.3798828125, floorSegmentMB=0.9541015625, forceMergeDeletesPctAllowed=16.34364735226315, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.361549881501645
[junit4] 2> 1219109 WARN (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1219134 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1219134 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1219135 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1219135 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1219136 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.6708984375, floorSegmentMB=1.9189453125, forceMergeDeletesPctAllowed=13.068365973161654, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24920180078429485
[junit4] 2> 1219136 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d27da77[collection1_shard2_replica_t41] main]
[junit4] 2> 1219137 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1219137 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1219137 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1219138 INFO (searcherExecutor-3472-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@1d27da77[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1219138 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587758046250008576
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33611/i_/zk/collection1_shard2_replica_t41/
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:33611/i_/zk/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1219140 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 1219141 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33611/i_/zk/collection1_shard2_replica_t41/ shard2
[junit4] 2> 1219242 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1219292 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1219293 INFO (qtp1124687369-11978) [n:127.0.0.1:33611_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1287
[junit4] 2> 1219294 INFO (qtp1124687369-11976) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33611_i_%252Fzk&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1296
[junit4] 2> 1219343 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001 of type TLOG
[junit4] 2> 1219343 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1219344 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2fac0ae7{/i_/zk,null,AVAILABLE}
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@114c1234{HTTP/1.1,[http/1.1]}{127.0.0.1:33381}
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server Started @1222140ms
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/i_/zk, hostPort=46677, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001/cores}
[junit4] 2> 1219346 ERROR (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1219346 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1219347 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T12:14:29.585Z
[junit4] 2> 1219347 INFO (zkConnectionManagerCallback-1717-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1219348 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1219348 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001/solr.xml
[junit4] 2> 1219350 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1219350 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1219350 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1219352 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40901/solr
[junit4] 2> 1219353 INFO (zkConnectionManagerCallback-1721-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1219354 INFO (zkConnectionManagerCallback-1723-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1219356 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1219356 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1219357 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46677_i_%2Fzk
[junit4] 2> 1219362 INFO (zkCallback-1704-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1219362 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1219362 INFO (zkCallback-1694-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1219362 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1219421 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1219427 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1219427 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1219428 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001/cores
[junit4] 2> 1219458 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1219459 INFO (qtp1124687369-11977) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46677_i_%252Fzk&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1219461 INFO (OverseerCollectionConfigSetProcessor-99234877612556292-127.0.0.1:38969_i_%2Fzk-n_0000000000) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1219461 INFO (OverseerThreadFactory-3458-thread-4-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46677_i_%2Fzk for creating new replica
[junit4] 2> 1219462 INFO (SocketProxy-Acceptor-46677) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=33750,localport=46677], receiveBufferSize:531000
[junit4] 2> 1219462 INFO (SocketProxy-Acceptor-46677) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=33381,localport=55122], receiveBufferSize=530904
[junit4] 2> 1219463 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1219463 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1219567 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1219567 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1220480 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1220509 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 1220598 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1220633 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 1220633 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1220633 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1220633 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 1220635 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=58.3798828125, floorSegmentMB=0.9541015625, forceMergeDeletesPctAllowed=16.34364735226315, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.361549881501645
[junit4] 2> 1220637 WARN (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1220672 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1220673 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1220674 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1220674 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1220675 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.6708984375, floorSegmentMB=1.9189453125, forceMergeDeletesPctAllowed=13.068365973161654, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24920180078429485
[junit4] 2> 1220675 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@6986de02[collection1_shard1_replica_t43] main]
[junit4] 2> 1220676 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1220677 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1220677 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1220677 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587758047863767040
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46677/i_/zk/collection1_shard1_replica_t43/
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:46677/i_/zk/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1220680 INFO (searcherExecutor-3483-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@6986de02[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1220680 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 1220682 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46677/i_/zk/collection1_shard1_replica_t43/ shard1
[junit4] 2> 1220782 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1220782 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1220832 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1220840 INFO (qtp1853015287-12013) [n:127.0.0.1:46677_i_%2Fzk c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1376
[junit4] 2> 1220841 INFO (qtp1124687369-11977) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46677_i_%252Fzk&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1381
[junit4] 2> 1220890 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001 of type TLOG
[junit4] 2> 1220891 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1220892 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22ca0e0d{/i_/zk,null,AVAILABLE}
[junit4] 2> 1220892 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@12df52ea{HTTP/1.1,[http/1.1]}{127.0.0.1:44733}
[junit4] 2> 1220892 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.e.j.s.Server Started @1223686ms
[junit4] 2> 1220892 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/i_/zk, hostPort=32853, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001/cores}
[junit4] 2> 1220892 ERROR (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1220893 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1220893 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1220893 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1220893 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T12:14:31.131Z
[junit4] 2> 1220894 INFO (zkConnectionManagerCallback-1727-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1220894 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1220894 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001/solr.xml
[junit4] 2> 1220896 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1220896 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1220897 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1220898 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40901/solr
[junit4] 2> 1220899 INFO (zkConnectionManagerCallback-1731-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1220900 INFO (zkConnectionManagerCallback-1733-thread-1-processing-n:127.0.0.1:32853_i_%2Fzk) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1220902 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1220903 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1220903 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32853_i_%2Fzk
[junit4] 2> 1220906 INFO (zkCallback-1704-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1220906 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1220906 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1220906 INFO (zkCallback-1694-thread-2-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1220906 INFO (zkCallback-1732-thread-1-processing-n:127.0.0.1:32853_i_%2Fzk) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1220972 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1220982 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1220982 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1220984 INFO (TEST-HttpPartitionTest.test-seed#[D1D587E834EF82B4]) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001/cores
[junit4] 2> 1221004 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1221004 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1221024 INFO (SocketProxy-Acceptor-32853) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40708,localport=32853], receiveBufferSize:531000
[junit4] 2> 1221025 INFO (SocketProxy-Acceptor-32853) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44733,localport=33298], receiveBufferSize=530904
[junit4] 2> 1221025 INFO (qtp1777058981-12047) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:32853_i_%252Fzk&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1221026 INFO (OverseerCollectionConfigSetProcessor-99234877612556292-127.0.0.1:38969_i_%2Fzk-n_0000000000) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1221027 INFO (OverseerThreadFactory-3458-thread-5-processing-n:127.0.0.1:38969_i_%2Fzk) [n:127.0.0.1:38969_i_%2Fzk ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:32853_i_%2Fzk for creating new replica
[junit4] 2> 1221028 INFO (SocketProxy-Acceptor-32853) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40712,localport=32853], receiveBufferSize:531000
[junit4] 2> 1221028 INFO (SocketProxy-Acceptor-32853) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44733,localport=33302], receiveBufferSize=530904
[junit4] 2> 1221031 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1221031 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1221136 INFO (zkCallback-1732-thread-1-processing-n:127.0.0.1:32853_i_%2Fzk) [n:127.0.0.1:32853_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1221136 INFO (zkCallback-1722-thread-1-processing-n:127.0.0.1:46677_i_%2Fzk) [n:127.0.0.1:46677_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1221136 INFO (zkCallback-1712-thread-1-processing-n:127.0.0.1:33611_i_%2Fzk) [n:127.0.0.1:33611_i_%2Fzk ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1222050 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1222058 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 1222158 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1222168 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 1222168 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@a42e3f5
[junit4] 2> 1222168 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1222168 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D1D587E834EF82B4-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 1222170 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=58.3798828125, floorSegmentMB=0.9541015625, forceMergeDeletesPctAllowed=16.34364735226315, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.361549881501645
[junit4] 2> 1222172 WARN (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1222205 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1222205 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1222207 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1222207 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1222208 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.6708984375, floorSegmentMB=1.9189453125, forceMergeDeletesPctAllowed=13.068365973161654, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24920180078429485
[junit4] 2> 1222208 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c34e5b5[collection1_shard2_replica_t45] main]
[junit4] 2> 1222208 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1222209 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1222209 INFO (qtp1777058981-12049) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1222210 INFO (searcherExecutor-3494-thread-1-processing-n:127.0.0.1:32853_i_%2Fzk x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:32853_i_%2Fzk c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@3c34e5b5[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1222210 INFO (q
[...truncated too long message...]
se) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2977127 INFO (TEST-TestDistribStateManager.testListData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testListData
[junit4] 2> 2977127 INFO (TEST-TestDistribStateManager.testListData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 2977127 INFO (TEST-TestDistribStateManager.testListData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testListData
[junit4] 2> 2977131 INFO (TEST-TestDistribStateManager.testHasData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testHasData
[junit4] 2> 2977131 INFO (TEST-TestDistribStateManager.testHasData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 2977131 INFO (TEST-TestDistribStateManager.testHasData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testHasData
[junit4] 2> 2977135 INFO (TEST-TestDistribStateManager.testMulti-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMulti
[junit4] 2> 2977135 INFO (TEST-TestDistribStateManager.testMulti-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 2977135 INFO (TEST-TestDistribStateManager.testMulti-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMulti
[junit4] 2> 2977139 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testGetSetRemoveData
[junit4] 2> 2977140 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2977140 INFO (Thread-3581) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2977140 INFO (Thread-3581) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2977142 ERROR (Thread-3581) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2977240 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkTestServer start zk server on port:38213
[junit4] 2> 2977247 INFO (zkConnectionManagerCallback-3234-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2977247 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 2977263 INFO (zkConnectionManagerCallback-3236-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2977263 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.client.solrj.impl.ZkDistribStateManager
[junit4] 2> 2982264 ERROR (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2982265 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38213 38213
[junit4] 2> 2987394 INFO (Thread-3581) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38213 38213
[junit4] 2> 2987400 INFO (TEST-TestDistribStateManager.testGetSetRemoveData-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testGetSetRemoveData
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistribStateManager -Dtests.method=testGetSetRemoveData -Dtests.seed=D1D587E834EF82B4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nn-NO -Dtests.timezone=Iceland -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 10.3s J1 | TestDistribStateManager.testGetSetRemoveData <<<
[junit4] > Throwable #1: java.lang.AssertionError: Node watch should have fired!
[junit4] > at __randomizedtesting.SeedInfo.seed([D1D587E834EF82B4:F74568BA606144BE]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.sim.TestDistribStateManager.testGetSetRemoveData(TestDistribStateManager.java:256)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2987406 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateMode
[junit4] 2> 2987406 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 2987407 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[D1D587E834EF82B4]) [ ] o.a.s.c.a.s.TestDistribStateManager Using org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager
[junit4] 2> 2987407 INFO (TEST-TestDistribStateManager.testCreateMode-seed#[D1D587E834EF82B4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateMode
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestDistribStateManager_D1D587E834EF82B4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=505, maxMBSortInHeap=6.72695574411102, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@66e40ee0), locale=nn-NO, timezone=Iceland
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=85589352,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [BlockDirectoryTest, TestSha256AuthenticationProvider, ChaosMonkeySafeLeaderWithPullReplicasTest, TestLazyCores, MergeStrategyTest, TestPolicyCloud, DistributedFacetPivotWhiteBoxTest, TestFastWriter, TestDocumentBuilder, TestNumericTokenStream, CloudExitableDirectoryReaderTest, SolrIndexSplitterTest, DistanceUnitsTest, TestBulkSchemaAPI, DocValuesMultiTest, TestSearcherReuse, TestOrdValues, TestRetrieveFieldsOptimizer, DistributedExpandComponentTest, TestComplexPhraseQParserPlugin, TestSchemaResource, TestAuthorizationFramework, TestExpandComponent, QueryEqualityTest, PingRequestHandlerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestStressLucene, DistribDocExpirationUpdateProcessorTest, TestScoreJoinQPNoScore, OverseerTaskQueueTest, TestFieldCacheVsDocValues, HdfsLockFactoryTest, HLLUtilTest, TestNumericTerms32, PolyFieldTest, TestLuceneMatchVersion, TestSolrQueryParser, BinaryUpdateRequestHandlerTest, TestManagedResource, OutOfBoxZkACLAndCredentialsProvidersTest, SimpleCollectionCreateDeleteTest, TestConfigSetsAPI, NotRequiredUniqueKeyTest, TestCorePropertiesReload, RulesTest, TestBM25SimilarityFactory, SolrRequestParserTest, TestConfigsApi, TestFieldCacheReopen, TestSolrCloudSnapshots, CdcrVersionReplicationTest, BadIndexSchemaTest, DOMUtilTest, TestSerializedLuceneMatchVersion, TestXIncludeConfig, GraphQueryTest, TestRemoteStreaming, VersionInfoTest, LeaderFailoverAfterPartitionTest, HdfsChaosMonkeyNothingIsSafeTest, CdcrReplicationDistributedZkTest, WrapperMergePolicyFactoryTest, TestCollationField, TestClusterProperties, TestCloudInspectUtil, AssignTest, HighlighterConfigTest, TestXmlQParser, HdfsTlogReplayBufferedWhileIndexingTest, TestFilteredDocIdSet, TestInitQParser, LeaderInitiatedRecoveryOnShardRestartTest, OutputWriterTest, TestCryptoKeys, TestLargeCluster, TestGeoJSONResponseWriter, TestUnifiedSolrHighlighter, SolrMetricReporterTest, TestMultiValuedNumericRangeQuery, AnalyticsQueryTest, OpenExchangeRatesOrgProviderTest, ManagedSchemaRoundRobinCloudTest, ZkSolrClientTest, SuggesterTSTTest, StatsReloadRaceTest, TestObjectReleaseTracker, SaslZkACLProviderTest, HdfsRestartWhileUpdatingTest, TestSolrCloudWithHadoopAuthPlugin, TestCloudPseudoReturnFields, TestDocBasedVersionConstraints, TestPushWriter, PrimUtilsTest, TestJettySolrRunner, TestFieldTypeCollectionResource, SolrXmlInZkTest, TestQueryWrapperFilter, ExecutePlanActionTest, TestAddFieldRealTimeGet, TestTestInjection, VMParamsZkACLAndCredentialsProvidersTest, ExplicitHLLTest, SpellingQueryConverterTest, TestConfigSetImmutable, RegexBoostProcessorTest, DistributedTermsComponentTest, DocumentAnalysisRequestHandlerTest, TestSystemCollAutoCreate, TestCloudSchemaless, TestRangeQuery, BlockJoinFacetDistribTest, TestSolr4Spatial, TestStandardQParsers, TermVectorComponentDistributedTest, TestLegacyFieldReuse, SampleTest, SuggesterFSTTest, ShowFileRequestHandlerTest, TestRebalanceLeaders, CircularListTest, TestPerFieldSimilarity, PathHierarchyTokenizerFactoryTest, CollectionTooManyReplicasTest, SynonymTokenizerTest, BasicAuthIntegrationTest, BasicDistributedZkTest, SoftAutoCommitTest, ResourceLoaderTest, TestFastLRUCache, TestSystemIdResolver, DateFieldTest, TestLRUCache, ZkNodePropsTest, FileUtilsTest, DistributedIntervalFacetingTest, AliasIntegrationTest, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, MissingSegmentRecoveryTest, MoveReplicaHDFSFailoverTest, OverseerModifyCollectionTest, RemoteQueryErrorTest, RestartWhileUpdatingTest, RollingRestartTest, TestCollectionsAPIViaSolrCloudCluster, TestLocalFSCloudBackupRestore, TestPrepRecovery, TestRandomFlRTGCloud, TestRequestForwarding, TestRequestStatusCollectionAPI, TestStressCloudBlindAtomicUpdates, TestTlogReplica, SearchRateTriggerTest, TestClusterStateProvider, TestComputePlanAction, TestDistribStateManager]
[junit4] Completed [583/765 (2!)] on J1 in 10.31s, 5 tests, 1 failure <<< FAILURES!
[...truncated 48661 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build #
21138 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21138/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple2 null Live Nodes: [127.0.0.1:45895_solr, 127.0.0.1:46147_solr] Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/16)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testSimple2_shard1_replica_n1", "base_url":"https://127.0.0.1:45895/solr", "node_name":"127.0.0.1:45895_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"testSimple2_shard1_replica_n2", "base_url":"https://127.0.0.1:38883/solr", "node_name":"127.0.0.1:38883_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testSimple2_shard2_replica_n4", "base_url":"https://127.0.0.1:45895/solr", "node_name":"127.0.0.1:45895_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node8":{ "core":"testSimple2_shard2_replica_n6", "base_url":"https://127.0.0.1:38883/solr", "node_name":"127.0.0.1:38883_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple2
null
Live Nodes: [127.0.0.1:45895_solr, 127.0.0.1:46147_solr]
Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/16)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testSimple2_shard1_replica_n1",
"base_url":"https://127.0.0.1:45895/solr",
"node_name":"127.0.0.1:45895_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"testSimple2_shard1_replica_n2",
"base_url":"https://127.0.0.1:38883/solr",
"node_name":"127.0.0.1:38883_solr",
"state":"down",
"type":"NRT"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testSimple2_shard2_replica_n4",
"base_url":"https://127.0.0.1:45895/solr",
"node_name":"127.0.0.1:45895_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node8":{
"core":"testSimple2_shard2_replica_n6",
"base_url":"https://127.0.0.1:38883/solr",
"node_name":"127.0.0.1:38883_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([CC7B4B8435C7C78A:F4C86F7A1234135B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:126)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple
Error Message:
IOException occured when talking to server at: http://127.0.0.1:40161/solr
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:40161/solr
at __randomizedtesting.SeedInfo.seed([CC7B4B8435C7C78A:F4C86F7A1234135B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple(AutoAddReplicasPlanActionTest.java:110)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40161 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 47 more
FAILED: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction.testIntegration
Error Message:
Stack Trace:
java.util.ConcurrentModificationException
at __randomizedtesting.SeedInfo.seed([CC7B4B8435C7C78A:7C1A45A810F866AF]:0)
at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:939)
at java.base/java.util.ArrayList$Itr.next(ArrayList.java:893)
at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.tearDown(SimSolrCloudTestCase.java:141)
at jdk.internal.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12805 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestExecutePlanAction_CC7B4B8435C7C78A-001/init-core-data-001
[junit4] 2> 1429041 WARN (SUITE-TestExecutePlanAction-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 1429041 INFO (SUITE-TestExecutePlanAction-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1429042 INFO (SUITE-TestExecutePlanAction-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1429042 INFO (SUITE-TestExecutePlanAction-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1429043 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1429043 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 1429043 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429043 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 1429044 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 1429044 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429044 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 1429044 DEBUG (ScheduledTrigger-5046-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429045 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExecute
[junit4] 2> 1429045 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1429045 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1429045 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 1429045 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1429045 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1429046 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429046 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1247)
[junit4] 2> at java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:154)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1429048 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1429048 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1429049 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429049 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
[junit4] 2> 1429049 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1429049 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429049 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1429049 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429069 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429090 DEBUG (ScheduledTrigger-5049-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429110 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429130 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429150 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429151 DEBUG (simCloudManagerPool-5048-thread-1) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testExecute
[junit4] 2> 1429162 DEBUG (simCloudManagerPool-5048-thread-1) [ ] o.a.s.c.Assign Identify nodes using default
[junit4] 2> 1429171 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429189 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction Collection ready after 1118ms
[junit4] 2> 1429191 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429191 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"15037f05e7ac2040Tc6jw4u7gyhltezfcysale4iry",
[junit4] 2> "source":"mock_trigger_name",
[junit4] 2> "eventTime":1514193563065000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1514193563065000000],
[junit4] 2> "nodeNames":["127.0.0.1:10007_solr"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica@61e7b541, org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction$1@702bdaef]}
[junit4] 2> 1429191 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testExecute&targetNode=127.0.0.1:10006_solr&inPlaceMove=true&replica=core_node1
[junit4] 2> 1429211 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429231 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429251 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429272 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429292 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429293 DEBUG (simCloudManagerPool-5048-thread-4) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node4":{
[junit4] 2> "core":"testExecute_shard1_replica_n3",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testExecute",
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "type":"NRT"}}
[junit4] 2> 1429312 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429332 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429352 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429373 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429393 DEBUG (ScheduledTrigger-5049-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429405 DEBUG (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=OVERSEERSTATUS
[junit4] 2> 1429406 DEBUG (simCloudManagerPool-5048-thread-5) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testExecute / shard1: {"core_node2":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testExecute_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testExecute"}}
[junit4] 2> 1429406 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction Collection ready after 6ms
[junit4] 2> 1429406 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction -------------_ FINAL STATE --------------
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":980,
[junit4] 2> "sysprop.java.version":"9.0.1",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10007_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":0,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":1000,
[junit4] 2> "sysprop.java.version":"9.0.1",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10007_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10007,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Live nodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Collection testExecute state: DocCollection(testExecute//clusterstate.json/3)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testExecute_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "node_name":"127.0.0.1:10006_solr",
[junit4] 2> "core":"testExecute_shard1_replica_n3",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "type":"NRT"}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExecute
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 2
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 1
[junit4] 2> 1429407 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testExecute]
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testExecute 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - DELETESTATUS 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - MOVEREPLICA 1
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - OVERSEERSTATUS 1
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - REQUESTSTATUS 2
[junit4] 2> 1429408 INFO (TEST-TestExecutePlanAction.testExecute-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 1429410 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testIntegration
[junit4] 2> 1429410 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1429410 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1429410 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
[junit4] 2> 1429410 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429411 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1247)
[junit4] 2> at java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:154)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1429411 DEBUG (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
[junit4] 2> 1429411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1429412 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429412 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1429412 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429432 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429452 DEBUG (ScheduledTrigger-5052-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429472 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429492 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429513 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429513 DEBUG (simCloudManagerPool-5051-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1429513 DEBUG (simCloudManagerPool-5051-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 1429514 DEBUG (simCloudManagerPool-5051-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429514 DEBUG (simCloudManagerPool-5051-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10007_solr]
[junit4] 2> 1429514 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 1429514 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1429514 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 1429514 DEBUG (simCloudManagerPool-5051-thread-2) [ ] o.a.s.c.o.ClusterStateMutator building a new cName: testIntegration
[junit4] 2> 1429514 DEBUG (ScheduledTrigger-5052-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1429524 DEBUG (simCloudManagerPool-5051-thread-2) [ ] o.a.s.c.Assign Identify nodes using default
[junit4] 2> 1429533 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1429534 DEBUG (ScheduledTrigger-5052-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 1429547 DEBUG (simCloudManagerPool-5051-thread-5) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testIntegration / shard1: {"core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "core":"testIntegration_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testIntegration"}}
[junit4] 2> 1429553 DEBUG (ScheduledTrigger-5052-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1429553 DEBUG (ScheduledTrigger-5052-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10006_solr
[junit4] 2> 1429555 DEBUG (ScheduledTrigger-5052-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 1429555 DEBUG (ScheduledTrigger-5052-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10006_solr
[junit4] 2> 1429573 DEBUG (ScheduledTrigger-5052-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1429575 DEBUG (ScheduledTrigger-5052-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 1429575 DEBUG (ScheduledTrigger-5052-thread-2) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:10006_solr]
[junit4] 2> 1429575 DEBUG (ScheduledTrigger-5052-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"6ef0ef5dfcce1Tc6jw4u7gyhltezfcysale4irz",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":1951697393929441,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1951697393929441],
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}}
[junit4] 2> 1429576 DEBUG (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"6ef0ef5dfcce1Tc6jw4u7gyhltezfcysale4irz",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":1951697393929441,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1951697393929441],
[junit4] 2> "_enqueue_time_":1951698411131141,
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}}
[junit4] 2> 1429576 DEBUG (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"6ef0ef5dfcce1Tc6jw4u7gyhltezfcysale4irz",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":1951697393929441,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1951697393929441],
[junit4] 2> "_enqueue_time_":1951698411131141,
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 1429577 INFO (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testIntegration&targetNode=127.0.0.1:10007_solr&inPlaceMove=true&replica=core_node2
[junit4] 2> 1429577 INFO (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1951698503 sessionWrapper.createTime 1951698492737041, this.sessionWrapper.createTime 1951698492737041
[junit4] 2> 1429577 DEBUG (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"6ef0ef5dfcce1Tc6jw4u7gyhltezfcysale4irz",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":1951697393929441,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1951697393929441],
[junit4] 2> "_enqueue_time_":1951698411131141,
[junit4] 2> "nodeNames":["127.0.0.1:10006_solr"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica@b579960], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 1429577 DEBUG (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testIntegration&targetNode=127.0.0.1:10007_solr&inPlaceMove=true&replica=core_node2
[junit4] 2> 1429678 DEBUG (simCloudManagerPool-5051-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node4":{
[junit4] 2> "core":"testIntegration_shard1_replica_n3",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testIntegration",
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "type":"NRT"}}
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction -------------_ FINAL STATE --------------
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Node values: {
[junit4] 2> "127.0.0.1:10006_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":1,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":970,
[junit4] 2> "sysprop.java.version":"9.0.1",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10006_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10006,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
[junit4] 2> "127.0.0.1:10007_solr":{
[junit4] 2> "sysprop.java.vendor":"Oracle Corporation",
[junit4] 2> "cores":2,
[junit4] 2> "host":"127.0.0.1",
[junit4] 2> "freedisk":980,
[junit4] 2> "sysprop.java.version":"9.0.1",
[junit4] 2> "ip_1":"127",
[junit4] 2> "ip_3":"0",
[junit4] 2> "ip_2":"0",
[junit4] 2> "ip_4":"1",
[junit4] 2> "node":"127.0.0.1:10007_solr",
[junit4] 2> "metrics:solr.jvm:buffers.direct.Count":0,
[junit4] 2> "port":10007,
[junit4] 2> "heapUsage":123450000,
[junit4] 2> "sysLoadAvg":1.0,
[junit4] 2> "metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Live nodes: [127.0.0.1:10007_solr]
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.TestExecutePlanAction * Collection testIntegration state: DocCollection(testIntegration//clusterstate.json/10)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testIntegration_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "core":"testIntegration_shard1_replica_n3",
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInBytes":123450000,
[junit4] 2> "type":"NRT"}},
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testIntegration
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase
[junit4] 2>
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
[junit4] 2>
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 1
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 0
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 1
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10006_solr
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testIntegration]
[junit4] 2> 1429789 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 2
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 2
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 2
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testIntegration 2
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 2
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - DELETESTATUS 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - MOVEREPLICA 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - REQUESTSTATUS 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 1
[junit4] 2> 1429790 INFO (TEST-TestExecutePlanAction.testIntegration-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 1429790 DEBUG (AutoscalingActionExecutor-5053-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 10743 ms for event id=6ef0ef5dfcce1Tc6jw4u7gyhltezfcysale4irz
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestExecutePlanAction -Dtests.method=testIntegration -Dtests.seed=CC7B4B8435C7C78A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-TD -Dtests.timezone=Pacific/Efate -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.38s J2 | TestExecutePlanAction.testIntegration <<<
[junit4] > Throwable #1: java.util.ConcurrentModificationException
[junit4] > at __randomizedtesting.SeedInfo.seed([CC7B4B8435C7C78A:7C1A45A810F866AF]:0)
[junit4] > at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:939)
[junit4] > at java.base/java.util.ArrayList$Itr.next(ArrayList.java:893)
[junit4] > at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.tearDown(SimSolrCloudTestCase.java:141)
[junit4] > at jdk.internal.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1429792 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1429793 DEBUG (SUITE-TestExecutePlanAction-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestExecutePlanAction_CC7B4B8435C7C78A-001
[junit4] 2> Dec 25, 2017 9:19:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1216, maxMBSortInHeap=7.8437959522432985, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@46ddd939), locale=fr-TD, timezone=Pacific/Efate
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=157442904,total=524288000
[junit4] 2> NOTE: All tests run in this JVM: [LegacyCloudClusterPropTest, BasicDistributedZk2Test, DeleteStatusTest, TestRandomCollapseQParserPlugin, XmlUpdateRequestHandlerTest, TestSolrDeletionPolicy2, AnalysisErrorHandlingTest, BlockJoinFacetRandomTest, TestStreamBody, TestRTimerTree, TestXmlQParserPlugin, TestSolrCoreSnapshots, CSVRequestHandlerTest, TestReload, TestNumericRangeQuery32, TestCustomSort, TestSearchPerf, TestTolerantSearch, ReturnFieldsTest, SystemLogListenerTest, TestCustomStream, XsltUpdateRequestHandlerTest, SolrTestCaseJ4Test, TestHashPartitioner, TestSchemaSimilarityResource, DocValuesMissingTest, HdfsUnloadDistributedZkTest, TestTolerantUpdateProcessorCloud, TestDistributedMissingSort, ImplicitSnitchTest, FacetPivotSmallTest, TestNodeAddedTrigger, ReplaceNodeTest, SuggesterTest, TestCopyFieldCollectionResource, TestManagedResourceStorage, TestExtendedDismaxParser, TestElisionMultitermQuery, TestInfoStreamLogging, SuggestComponentTest, TestLegacyNumericUtils, OverseerTest, RollingRestartTest, ZkNodePropsTest, TestCollectionAPI, TestSizeLimitedDistributedMap, ConnectionReuseTest, TestPartialUpdateDeduplication, TestLMJelinekMercerSimilarityFactory, TestLRUCache, TestCloudJSONFacetJoinDomain, PeerSyncReplicationTest, TestSolrConfigHandlerCloud, UniqFieldsUpdateProcessorFactoryTest, OverriddenZkACLAndCredentialsProvidersTest, TestStressUserVersions, LeaderFailureAfterFreshStartTest, ExitableDirectoryReaderTest, ChaosMonkeyNothingIsSafeTest, ClusterStateTest, TestFuzzyAnalyzedSuggestions, TestStressInPlaceUpdates, TestLegacyNumericRangeQueryBuilder, TestRealTimeGet, FieldAnalysisRequestHandlerTest, TestSolrQueryResponse, EchoParamsTest, TestScoreJoinQPScore, CopyFieldTest, SolrCLIZkUtilsTest, BigEndianAscendingWordSerializerTest, TestLockTree, TestConfigSetsAPIExclusivity, SecurityConfHandlerTest, SuggesterWFSTTest, ShardSplitTest, TestQueryTypes, PluginInfoTest, TestDocTermOrds, TestExactStatsCache, TemplateUpdateProcessorTest, MultiThreadedOCPTest, TestSortByMinMaxFunction, TolerantUpdateProcessorTest, MoveReplicaHDFSFailoverTest, HdfsRecoverLeaseTest, TestBulkSchemaConcurrent, TestDefaultStatsCache, ChangedSchemaMergeTest, TestSchemaManager, SortByFunctionTest, TestBackupRepositoryFactory, TlogReplayBufferedWhileIndexingTest, TestDelegationWithHadoopAuth, TestSSLRandomization, TestApiFramework, TestUseDocValuesAsStored2, TestCoreContainer, TestSlowCompositeReaderWrapper, SimpleMLTQParserTest, AddSchemaFieldsUpdateProcessorFactoryTest, BlobRepositoryCloudTest, TestReloadAndDeleteDocs, TestBlobHandler, TestCollationFieldDocValues, TestFunctionQuery, TestRawResponseWriter, TestExecutePlanAction]
[junit4] Completed [341/765 (1!)] on J2 in 1.02s, 2 tests, 1 error <<< FAILURES!
[...truncated 722 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/init-core-data-001
[junit4] 2> 2497169 WARN (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
[junit4] 2> 2497170 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2497170 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 2497170 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2497170 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001
[junit4] 2> 2497170 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2497171 INFO (Thread-5391) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2497171 INFO (Thread-5391) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2497172 ERROR (Thread-5391) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2497271 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35207
[junit4] 2> 2497273 INFO (zkConnectionManagerCallback-8789-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497277 INFO (jetty-launcher-8786-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2497278 INFO (jetty-launcher-8786-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2497278 INFO (jetty-launcher-8786-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2497278 INFO (jetty-launcher-8786-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@203d7b70{/solr,null,AVAILABLE}
[junit4] 2> 2497279 INFO (jetty-launcher-8786-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35499ddd{/solr,null,AVAILABLE}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e44a9d7{/solr,null,AVAILABLE}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@653663ce{HTTP/1.1,[http/1.1]}{127.0.0.1:40161}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@756631de{HTTP/1.1,[http/1.1]}{127.0.0.1:42753}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-2) [ ] o.e.j.s.Server Started @2498718ms
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-1) [ ] o.e.j.s.Server Started @2498718ms
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40161}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42753}
[junit4] 2> 2497280 INFO (jetty-launcher-8786-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4ef18ab9{HTTP/1.1,[http/1.1]}{127.0.0.1:45839}
[junit4] 2> 2497281 ERROR (jetty-launcher-8786-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2497281 ERROR (jetty-launcher-8786-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T09:37:11.124642Z
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T09:37:11.124719Z
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-3) [ ] o.e.j.s.Server Started @2498718ms
[junit4] 2> 2497281 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45839}
[junit4] 2> 2497282 ERROR (jetty-launcher-8786-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2497282 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2497282 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2497282 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2497282 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T09:37:11.125479Z
[junit4] 2> 2497283 INFO (zkConnectionManagerCallback-8791-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497283 INFO (zkConnectionManagerCallback-8795-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497283 INFO (zkConnectionManagerCallback-8793-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497284 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2497284 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2497284 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2497288 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608d0879670003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2497290 INFO (jetty-launcher-8786-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35207/solr
[junit4] 2> 2497290 INFO (jetty-launcher-8786-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35207/solr
[junit4] 2> 2497291 INFO (zkConnectionManagerCallback-8801-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497291 INFO (zkConnectionManagerCallback-8803-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497292 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608d0879670004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2497293 INFO (zkConnectionManagerCallback-8805-thread-1-processing-n:127.0.0.1:45839_solr) [n:127.0.0.1:45839_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497293 INFO (zkConnectionManagerCallback-8807-thread-1-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497294 INFO (jetty-launcher-8786-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35207/solr
[junit4] 2> 2497295 INFO (zkConnectionManagerCallback-8811-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497296 INFO (zkConnectionManagerCallback-8813-thread-1-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497341 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2497341 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2497341 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45839_solr
[junit4] 2> 2497342 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40161_solr
[junit4] 2> 2497342 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.c.Overseer Overseer (id=99234259338199046-127.0.0.1:45839_solr-n_0000000000) starting
[junit4] 2> 2497342 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2497345 INFO (zkCallback-8806-thread-1-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2497345 INFO (zkCallback-8812-thread-1-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2497345 INFO (zkCallback-8804-thread-1-processing-n:127.0.0.1:45839_solr) [n:127.0.0.1:45839_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2497345 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42753_solr
[junit4] 2> 2497346 INFO (zkCallback-8804-thread-1-processing-n:127.0.0.1:45839_solr) [n:127.0.0.1:45839_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2497346 INFO (zkCallback-8812-thread-1-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2497347 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45839_solr
[junit4] 2> 2497348 INFO (zkCallback-8806-thread-1-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2497349 INFO (zkCallback-8804-thread-1-processing-n:127.0.0.1:45839_solr) [n:127.0.0.1:45839_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2497349 INFO (zkCallback-8812-thread-1-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2497349 INFO (zkCallback-8806-thread-2-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2497370 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45839.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497370 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40161.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497374 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42753.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497375 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45839.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497375 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40161.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497375 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45839.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497375 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40161.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497376 INFO (jetty-launcher-8786-thread-2) [n:127.0.0.1:40161_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node2/.
[junit4] 2> 2497376 INFO (jetty-launcher-8786-thread-3) [n:127.0.0.1:45839_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node3/.
[junit4] 2> 2497379 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42753.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497380 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42753.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2497380 INFO (jetty-launcher-8786-thread-1) [n:127.0.0.1:42753_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node1/.
[junit4] 2> 2497419 INFO (zkConnectionManagerCallback-8821-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497421 INFO (zkConnectionManagerCallback-8825-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2497422 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2497422 INFO (SUITE-AutoAddReplicasPlanActionTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35207/solr ready
[junit4] 2> 2497429 INFO (TEST-AutoAddReplicasPlanActionTest.testSimple-seed#[CC7B4B8435C7C78A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 2497430 INFO (qtp1986508110-31491) [n:127.0.0.1:45839_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:42753_solr,127.0.0.1:40161_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2497431 INFO (OverseerThreadFactory-7726-thread-1-processing-n:127.0.0.1:45839_solr) [n:127.0.0.1:45839_solr ] o.a.s.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 2497536 INFO (OverseerStateUpdate-99234259338199046-127.0.0.1:45839_solr-n_0000000000) [n:127.0.0.1:45839_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42753/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2497537 INFO (OverseerStateUpdate-99234259338199046-127.0.0.1:45839_solr-n_0000000000) [n:127.0.0.1:45839_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40161/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2497539 INFO (OverseerStateUpdate-99234259338199046-127.0.0.1:45839_solr-n_0000000000) [n:127.0.0.1:45839_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42753/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2497540 INFO (OverseerStateUpdate-99234259338199046-127.0.0.1:45839_solr-n_0000000000) [n:127.0.0.1:45839_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40161/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2497742 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2497742 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2497742 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2497742 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2497743 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2497743 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2497847 INFO (zkCallback-8806-thread-2-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2497847 INFO (zkCallback-8806-thread-1-processing-n:127.0.0.1:42753_solr) [n:127.0.0.1:42753_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2497847 INFO (zkCallback-8812-thread-2-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2497847 INFO (zkCallback-8812-thread-1-processing-n:127.0.0.1:40161_solr) [n:127.0.0.1:40161_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2498749 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2498749 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2498749 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2498756 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2498760 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2498760 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 2498760 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 2498762 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2498762 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2498762 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2498762 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 2498762 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 2498762 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2498762 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 2498762 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40161.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2498762 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42753.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2498762 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40161.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2498763 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2498762 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2498763 INFO (qtp652144990-31468) [n:127.0.0.1:42753_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node1/testSimple1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node1/./testSimple1_shard2_replica_n4/data/]
[junit4] 2> 2498763 INFO (qtp1361339907-31486) [n:127.0.0.1:40161_solr c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node2/testSimple1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node2/./testSimple1_shard2_replica_n6/data/]
[junit4] 2> 2498763 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2498763 INFO (qtp1361339907-31485) [n:127.0.0.1:40161_solr c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node2/testSimple1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoAddReplicasPlanActionTest_CC7B4B8435C7C78A-001/tempDir-001/node2/./testSimple1_shard1_replica_n2/data/]
[junit4] 2> 2498763 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2498763 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 2498763 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42753.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e5df980
[junit4] 2> 2498763 INFO (qtp652144990-31474) [n:127.0.0.1:42753_solr c:testSim
[...truncated too long message...]
tSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=29427554
[junit4] 2> 2637541 INFO (coreCloseExecutor-9355-thread-5) [n:127.0.0.1:46147_solr c:testSimple3 s:shard2 r:core_node5 x:testSimple3_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard2.leader, tag=972938759
[junit4] 2> 2637541 INFO (jetty-closer-4853-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99234259197624329-127.0.0.1:46147_solr-n_0000000001) closing
[junit4] 2> 2637541 INFO (OverseerStateUpdate-99234259197624329-127.0.0.1:46147_solr-n_0000000001) [n:127.0.0.1:46147_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46147_solr
[junit4] 2> 2637541 WARN (OverseerAutoScalingTriggerThread-99234259197624329-127.0.0.1:46147_solr-n_0000000001) [n:127.0.0.1:46147_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2637541 DEBUG (jetty-closer-4853-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 2637542 INFO (jetty-closer-4853-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@66c55fd0{/solr,null,UNAVAILABLE}
[junit4] 2> 2637542 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2637542 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[CC7B4B8435C7C78A]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41187 41187
[junit4] 2> 2637962 INFO (Thread-6843) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41187 41187
[junit4] 2> 2637962 WARN (Thread-6843) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 43 /solr/collections/testSimple1/state.json
[junit4] 2> 29 /solr/collections/testSimple2/state.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 5 /solr/collections/testSimple3/state.json
[junit4] 2> 3 /solr/collections/testSimple1/leader_elect/shard2/election/99234259197624329-core_node8-n_0000000000
[junit4] 2> 3 /solr/overseer_elect/election/99234259197624329-127.0.0.1:46147_solr-n_0000000001
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2> 2 /solr/collections/testSimple1/leader_elect/shard1/election/99234259197624329-core_node5-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_CC7B4B8435C7C78A-001
[junit4] 2> Dec 25, 2017 9:39:31 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@12a1d950), locale=zgh-MA, timezone=Pacific/Kwajalein
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=123706776,total=521142272
[junit4] 2> NOTE: All tests run in this JVM: [LegacyCloudClusterPropTest, BasicDistributedZk2Test, DeleteStatusTest, TestRandomCollapseQParserPlugin, XmlUpdateRequestHandlerTest, TestSolrDeletionPolicy2, AnalysisErrorHandlingTest, BlockJoinFacetRandomTest, TestStreamBody, TestRTimerTree, TestXmlQParserPlugin, TestSolrCoreSnapshots, CSVRequestHandlerTest, TestReload, TestNumericRangeQuery32, TestCustomSort, TestSearchPerf, TestTolerantSearch, ReturnFieldsTest, SystemLogListenerTest, TestCustomStream, XsltUpdateRequestHandlerTest, SolrTestCaseJ4Test, TestHashPartitioner, TestSchemaSimilarityResource, DocValuesMissingTest, HdfsUnloadDistributedZkTest, TestTolerantUpdateProcessorCloud, TestDistributedMissingSort, ImplicitSnitchTest, FacetPivotSmallTest, TestNodeAddedTrigger, ReplaceNodeTest, SuggesterTest, TestCopyFieldCollectionResource, TestManagedResourceStorage, TestExtendedDismaxParser, TestElisionMultitermQuery, TestInfoStreamLogging, SuggestComponentTest, TestLegacyNumericUtils, OverseerTest, RollingRestartTest, ZkNodePropsTest, TestCollectionAPI, TestSizeLimitedDistributedMap, ConnectionReuseTest, TestPartialUpdateDeduplication, TestLMJelinekMercerSimilarityFactory, TestLRUCache, TestCloudJSONFacetJoinDomain, PeerSyncReplicationTest, TestSolrConfigHandlerCloud, UniqFieldsUpdateProcessorFactoryTest, OverriddenZkACLAndCredentialsProvidersTest, TestStressUserVersions, LeaderFailureAfterFreshStartTest, ExitableDirectoryReaderTest, ChaosMonkeyNothingIsSafeTest, ClusterStateTest, TestFuzzyAnalyzedSuggestions, TestStressInPlaceUpdates, TestLegacyNumericRangeQueryBuilder, TestRealTimeGet, FieldAnalysisRequestHandlerTest, TestSolrQueryResponse, EchoParamsTest, TestScoreJoinQPScore, CopyFieldTest, SolrCLIZkUtilsTest, BigEndianAscendingWordSerializerTest, TestLockTree, TestConfigSetsAPIExclusivity, SecurityConfHandlerTest, SuggesterWFSTTest, ShardSplitTest, TestQueryTypes, PluginInfoTest, TestDocTermOrds, TestExactStatsCache, TemplateUpdateProcessorTest, MultiThreadedOCPTest, TestSortByMinMaxFunction, TolerantUpdateProcessorTest, MoveReplicaHDFSFailoverTest, HdfsRecoverLeaseTest, TestBulkSchemaConcurrent, TestDefaultStatsCache, ChangedSchemaMergeTest, TestSchemaManager, SortByFunctionTest, TestBackupRepositoryFactory, TlogReplayBufferedWhileIndexingTest, TestDelegationWithHadoopAuth, TestSSLRandomization, TestApiFramework, TestUseDocValuesAsStored2, TestCoreContainer, TestSlowCompositeReaderWrapper, SimpleMLTQParserTest, AddSchemaFieldsUpdateProcessorFactoryTest, BlobRepositoryCloudTest, TestReloadAndDeleteDocs, TestBlobHandler, TestCollationFieldDocValues, TestFunctionQuery, TestRawResponseWriter, TestExecutePlanAction, CoreAdminCreateDiscoverTest, TestLMDirichletSimilarityFactory, TestManagedSchemaAPI, PeerSyncWithIndexFingerprintCachingTest, TestPrepRecovery, AutoScalingHandlerTest, PreAnalyzedFieldManagedSchemaCloudTest, DocValuesNotIndexedTest, UtilsToolTest, OverseerRolesTest, TestValueSourceCache, CollectionReloadTest, TestSimpleQParserPlugin, JSONWriterTest, TestUniqueKeyFieldResource, HdfsAutoAddReplicasIntegrationTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, TestRandomDVFaceting, ZkControllerTest, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, DirectUpdateHandlerTest, HighlighterTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, CoreAdminHandlerTest, DocValuesTest, SuggesterTSTTest, TestStressLucene, TestTrie, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, SolrInfoBeanTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestOmitPositions, FileBasedSpellCheckerTest, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, IndexSchemaTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, MBeansHandlerTest, QueryParsingTest, TestAnalyzedSuggestions, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, TestLFUCache, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, BadComponentTest, TestBinaryField, TestConfig, OutputWriterTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestDFRSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, PrimUtilsTest, RAMDirectoryFactoryTest, UUIDFieldTest, TestRTGBase, TestCrossCoreJoin, TestSimpleTrackingShardHandler, AliasIntegrationTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CustomCollectionTest, DistribJoinFromCollectionTest, ForceLeaderTest, MissingSegmentRecoveryTest, MoveReplicaHDFSTest, TestCloudDeleteByQuery, TestCloudPseudoReturnFields, TestCloudRecovery, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestHdfsCloudBackupRestore, TestRandomRequestDistribution, TestRequestForwarding, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestStressCloudBlindAtomicUpdates, AutoAddReplicasIntegrationTest]
[junit4] Completed [570/765 (3!)] on J2 in 143.23s, 1 test, 1 failure <<< FAILURES!
[...truncated 41498 lines...]
[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build #
21137 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21137/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC
3 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at http://127.0.0.1:36129/solr/awhollynewcollection_0: No registered leader was found after waiting for 4000ms , collection: awhollynewcollection_0 slice: shard3 saw state=DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-bfffffff", "state":"active", "replicas":{ "core_node3":{ "core":"awhollynewcollection_0_shard1_replica_n1", "base_url":"http://127.0.0.1:46357/solr", "node_name":"127.0.0.1:46357_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"awhollynewcollection_0_shard1_replica_n2", "base_url":"http://127.0.0.1:35377/solr", "node_name":"127.0.0.1:35377_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"c0000000-ffffffff", "state":"active", "replicas":{ "core_node6":{ "core":"awhollynewcollection_0_shard2_replica_n4", "base_url":"http://127.0.0.1:41503/solr", "node_name":"127.0.0.1:41503_solr", "state":"active", "type":"NRT"}, "core_node8":{ "core":"awhollynewcollection_0_shard2_replica_n7", "base_url":"http://127.0.0.1:36129/solr", "node_name":"127.0.0.1:36129_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard3":{ "range":"0-3fffffff", "state":"active", "replicas":{ "core_node11":{ "core":"awhollynewcollection_0_shard3_replica_n9", "base_url":"http://127.0.0.1:46357/solr", "node_name":"127.0.0.1:46357_solr", "state":"active", "type":"NRT"}, "core_node13":{ "core":"awhollynewcollection_0_shard3_replica_n10", "base_url":"http://127.0.0.1:35377/solr", "node_name":"127.0.0.1:35377_solr", "state":"down", "type":"NRT"}}}, "shard4":{ "range":"40000000-7fffffff", "state":"active", "replicas":{ "core_node15":{ "core":"awhollynewcollection_0_shard4_replica_n12", "base_url":"http://127.0.0.1:41503/solr", "node_name":"127.0.0.1:41503_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node16":{ "core":"awhollynewcollection_0_shard4_replica_n14", "base_url":"http://127.0.0.1:36129/solr", "node_name":"127.0.0.1:36129_solr", "state":"active", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"3", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:46357_solr, 127.0.0.1:35377_solr, 127.0.0.1:36129_solr, 127.0.0.1:41503_solr]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36129/solr/awhollynewcollection_0: No registered leader was found after waiting for 4000ms , collection: awhollynewcollection_0 slice: shard3 saw state=DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/8)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-bfffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"awhollynewcollection_0_shard1_replica_n1",
"base_url":"http://127.0.0.1:46357/solr",
"node_name":"127.0.0.1:46357_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"awhollynewcollection_0_shard1_replica_n2",
"base_url":"http://127.0.0.1:35377/solr",
"node_name":"127.0.0.1:35377_solr",
"state":"down",
"type":"NRT"}}},
"shard2":{
"range":"c0000000-ffffffff",
"state":"active",
"replicas":{
"core_node6":{
"core":"awhollynewcollection_0_shard2_replica_n4",
"base_url":"http://127.0.0.1:41503/solr",
"node_name":"127.0.0.1:41503_solr",
"state":"active",
"type":"NRT"},
"core_node8":{
"core":"awhollynewcollection_0_shard2_replica_n7",
"base_url":"http://127.0.0.1:36129/solr",
"node_name":"127.0.0.1:36129_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard3":{
"range":"0-3fffffff",
"state":"active",
"replicas":{
"core_node11":{
"core":"awhollynewcollection_0_shard3_replica_n9",
"base_url":"http://127.0.0.1:46357/solr",
"node_name":"127.0.0.1:46357_solr",
"state":"active",
"type":"NRT"},
"core_node13":{
"core":"awhollynewcollection_0_shard3_replica_n10",
"base_url":"http://127.0.0.1:35377/solr",
"node_name":"127.0.0.1:35377_solr",
"state":"down",
"type":"NRT"}}},
"shard4":{
"range":"40000000-7fffffff",
"state":"active",
"replicas":{
"core_node15":{
"core":"awhollynewcollection_0_shard4_replica_n12",
"base_url":"http://127.0.0.1:41503/solr",
"node_name":"127.0.0.1:41503_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node16":{
"core":"awhollynewcollection_0_shard4_replica_n14",
"base_url":"http://127.0.0.1:36129/solr",
"node_name":"127.0.0.1:36129_solr",
"state":"active",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"3",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"} with live_nodes=[127.0.0.1:46357_solr, 127.0.0.1:35377_solr, 127.0.0.1:36129_solr, 127.0.0.1:41503_solr]
at __randomizedtesting.SeedInfo.seed([75FD759AB367EB30:3D88012EB554C4A5]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:461)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:36453
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:36453
at __randomizedtesting.SeedInfo.seed([75FD759AB367EB30:FDA94A401D9B86C8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:315)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.read(InputRecord.java:503)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 43 more
FAILED: org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeAdded
Error Message:
Stack Trace:
java.util.ConcurrentModificationException
at __randomizedtesting.SeedInfo.seed([75FD759AB367EB30:103E23ED11C44333]:0)
at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:901)
at java.util.ArrayList$Itr.next(ArrayList.java:851)
at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.tearDown(SimSolrCloudTestCase.java:141)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13012 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/init-core-data-001
[junit4] 2> 1251924 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=48 numCloses=48
[junit4] 2> 1251924 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1251926 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1251926 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1251927 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001
[junit4] 2> 1251927 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1251927 INFO (Thread-4124) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1251927 INFO (Thread-4124) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1251928 ERROR (Thread-4124) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1252027 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:39275
[junit4] 2> 1252029 INFO (zkConnectionManagerCallback-6257-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252030 INFO (jetty-launcher-6254-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1252030 INFO (jetty-launcher-6254-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1252030 INFO (jetty-launcher-6254-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1252030 INFO (jetty-launcher-6254-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1252031 INFO (jetty-launcher-6254-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17f188b{/solr,null,AVAILABLE}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@159db96{/solr,null,AVAILABLE}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13dddf{/solr,null,AVAILABLE}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@14008e{HTTP/1.1,[http/1.1]}{127.0.0.1:41503}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@11939a2{HTTP/1.1,[http/1.1]}{127.0.0.1:46357}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-3) [ ] o.e.j.s.Server Started @1253799ms
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-1) [ ] o.e.j.s.Server Started @1253799ms
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41503}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46357}
[junit4] 2> 1252032 INFO (jetty-launcher-6254-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@cf11f6{/solr,null,AVAILABLE}
[junit4] 2> 1252032 ERROR (jetty-launcher-6254-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1252033 INFO (jetty-launcher-6254-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@171908b{HTTP/1.1,[http/1.1]}{127.0.0.1:36129}
[junit4] 2> 1252033 INFO (jetty-launcher-6254-thread-4) [ ] o.e.j.s.Server Started @1253799ms
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1faff26{HTTP/1.1,[http/1.1]}{127.0.0.1:35377}
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36129}
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.e.j.s.Server Started @1253803ms
[junit4] 2> 1252032 ERROR (jetty-launcher-6254-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35377}
[junit4] 2> 1252037 ERROR (jetty-launcher-6254-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T05:15:42.776Z
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T05:15:42.776Z
[junit4] 2> 1252037 ERROR (jetty-launcher-6254-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1252037 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T05:15:42.776Z
[junit4] 2> 1252038 INFO (zkConnectionManagerCallback-6259-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252038 INFO (zkConnectionManagerCallback-6261-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252039 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1252039 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1252033 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1252042 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1252042 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1252042 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T05:15:42.781Z
[junit4] 2> 1252042 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1252042 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1252043 INFO (zkConnectionManagerCallback-6265-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252043 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1252046 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1252046 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1252046 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1252046 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1252047 INFO (zkConnectionManagerCallback-6263-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252048 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1252049 INFO (jetty-launcher-6254-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
[junit4] 2> 1252069 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1252069 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1252070 INFO (jetty-launcher-6254-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
[junit4] 2> 1252071 INFO (zkConnectionManagerCallback-6269-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252072 INFO (zkConnectionManagerCallback-6273-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252073 INFO (jetty-launcher-6254-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
[junit4] 2> 1252073 INFO (jetty-launcher-6254-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
[junit4] 2> 1252073 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608c1916cb0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1252074 INFO (zkConnectionManagerCallback-6279-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252074 INFO (zkConnectionManagerCallback-6281-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252075 INFO (zkConnectionManagerCallback-6283-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252075 INFO (zkConnectionManagerCallback-6285-thread-1-processing-n:127.0.0.1:36129_solr) [n:127.0.0.1:36129_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252076 INFO (zkConnectionManagerCallback-6289-thread-1-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252093 INFO (zkConnectionManagerCallback-6287-thread-1-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252101 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1252101 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41503_solr
[junit4] 2> 1252102 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.c.Overseer Overseer (id=99233231186624524-127.0.0.1:41503_solr-n_0000000000) starting
[junit4] 2> 1252120 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1252120 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1252121 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46357_solr
[junit4] 2> 1252125 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1252126 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41503_solr
[junit4] 2> 1252126 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1252133 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35377_solr
[junit4] 2> 1252137 INFO (OverseerStateUpdate-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1252138 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36129_solr
[junit4] 2> 1252153 INFO (zkCallback-6282-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1252153 INFO (zkCallback-6284-thread-1-processing-n:127.0.0.1:36129_solr) [n:127.0.0.1:36129_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1252153 INFO (zkCallback-6288-thread-1-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1252163 INFO (zkCallback-6286-thread-1-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1252229 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252237 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252237 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252238 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252238 INFO (jetty-launcher-6254-thread-2) [n:127.0.0.1:35377_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node2
[junit4] 2> 1252244 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252244 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252245 INFO (jetty-launcher-6254-thread-1) [n:127.0.0.1:46357_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node1
[junit4] 2> 1252304 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252312 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252312 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252313 INFO (jetty-launcher-6254-thread-3) [n:127.0.0.1:41503_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node3
[junit4] 2> 1252326 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252332 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252332 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252333 INFO (jetty-launcher-6254-thread-4) [n:127.0.0.1:36129_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node4
[junit4] 2> 1252365 INFO (zkConnectionManagerCallback-6299-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252367 INFO (zkConnectionManagerCallback-6303-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1252367 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1252368 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39275/solr ready
[junit4] 2> 1252389 INFO (TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[75FD759AB367EB30]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateShouldFailOnExistingCore
[junit4] 2> 1252390 INFO (TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[75FD759AB367EB30]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1252391 INFO (qtp8056611-20654) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollectionblocker&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1252392 INFO (OverseerThreadFactory-6061-thread-1-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.CreateCollectionCmd Create collection halfcollectionblocker
[junit4] 2> 1252392 WARN (OverseerThreadFactory-6061-thread-1-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (halfcollectionblocker) without cores.
[junit4] 2> 1252495 INFO (qtp8056611-20654) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1252495 INFO (qtp8056611-20654) [n:127.0.0.1:46357_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollectionblocker&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=104
[junit4] 2> 1252496 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35377_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1252497 INFO (OverseerCollectionConfigSetProcessor-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1252497 INFO (OverseerThreadFactory-6061-thread-2-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35377_solr for creating new replica
[junit4] 2> 1252498 INFO (OverseerStateUpdate-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"halfcollectionblocker",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35377/solr",
[junit4] 2> "node_name":"127.0.0.1:35377_solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1252700 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1252700 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1252708 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1252714 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.IndexSchema [halfcollection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1252717 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1252717 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica_n1' using configuration from collection halfcollectionblocker, trusted=true
[junit4] 2> 1252717 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollectionblocker.shard1.core_node21' (registry 'solr.core.halfcollectionblocker.shard1.core_node21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1252717 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1252717 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore [[halfcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node2/halfcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node2/halfcollection_shard1_replica_n1/data/]
[junit4] 2> 1252773 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1252773 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1252774 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1252774 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1252776 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@db92c8[halfcollection_shard1_replica_n1] main]
[junit4] 2> 1252777 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1252777 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1252777 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1252778 INFO (searcherExecutor-6070-thread-1-processing-n:127.0.0.1:35377_solr x:halfcollection_shard1_replica_n1 s:shard1 c:halfcollectionblocker r:core_node21) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1] Registered new searcher Searcher@db92c8[halfcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1252778 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587731699877281792
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35377/solr/halfcollection_shard1_replica_n1/
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35377/solr/halfcollection_shard1_replica_n1/ has no replicas
[junit4] 2> 1252781 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1252782 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35377/solr/halfcollection_shard1_replica_n1/ shard1
[junit4] 2> 1252883 INFO (zkCallback-6288-thread-1-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1252883 INFO (zkCallback-6288-thread-2-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1252933 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1252945 INFO (qtp2489907-20657) [n:127.0.0.1:35377_solr c:halfcollectionblocker s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=246
[junit4] 2> 1252948 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35377_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=452
[junit4] 2> 1252948 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollectionblocker2&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1252949 INFO (OverseerThreadFactory-6061-thread-3-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.CreateCollectionCmd Create collection halfcollectionblocker2
[junit4] 2> 1252949 INFO (OverseerCollectionConfigSetProcessor-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1252950 WARN (OverseerThreadFactory-6061-thread-3-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (halfcollectionblocker2) without cores.
[junit4] 2> 1253052 INFO (zkCallback-6288-thread-2-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253052 INFO (zkCallback-6288-thread-1-processing-n:127.0.0.1:35377_solr) [n:127.0.0.1:35377_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253153 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1253153 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollectionblocker2&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=204
[junit4] 2> 1253153 INFO (qtp8056611-20634) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46357_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker2&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1253154 INFO (OverseerCollectionConfigSetProcessor-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1253160 INFO (OverseerThreadFactory-6061-thread-4-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46357_solr for creating new replica
[junit4] 2> 1253161 INFO (OverseerStateUpdate-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"halfcollectionblocker2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46357/solr",
[junit4] 2> "node_name":"127.0.0.1:46357_solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1253362 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1253363 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1253371 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1253377 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.IndexSchema [halfcollection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1253379 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1253379 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica_n1' using configuration from collection halfcollectionblocker2, trusted=true
[junit4] 2> 1253380 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollectionblocker2.shard1.core_node21' (registry 'solr.core.halfcollectionblocker2.shard1.core_node21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1253380 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1253380 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore [[halfcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node1/halfcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node1/halfcollection_shard1_replica_n1/data/]
[junit4] 2> 1253414 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1253414 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1253415 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1253415 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1253416 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1083214[halfcollection_shard1_replica_n1] main]
[junit4] 2> 1253417 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1253417 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1253417 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1253418 INFO (searcherExecutor-6075-thread-1-processing-n:127.0.0.1:46357_solr x:halfcollection_shard1_replica_n1 s:shard1 c:halfcollectionblocker2 r:core_node21) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1] Registered new searcher Searcher@1083214[halfcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1253418 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587731700548370432
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46357/solr/halfcollection_shard1_replica_n1/
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:46357/solr/halfcollection_shard1_replica_n1/ has no replicas
[junit4] 2> 1253424 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1253425 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46357/solr/halfcollection_shard1_replica_n1/ shard1
[junit4] 2> 1253526 INFO (zkCallback-6282-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253526 INFO (zkCallback-6282-thread-2-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253575 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1253576 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr c:halfcollectionblocker2 s:shard1 r:core_node21 x:halfcollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=214
[junit4] 2> 1253577 INFO (qtp8056611-20634) [n:127.0.0.1:46357_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46357_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker2&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=424
[junit4] 2> 1253578 INFO (qtp8056611-20654) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=127.0.0.1:35377_solr,127.0.0.1:46357_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1253579 INFO (OverseerThreadFactory-6061-thread-5-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.CreateCollectionCmd Create collection halfcollection
[junit4] 2> 1253579 INFO (OverseerCollectionConfigSetProcessor-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1253680 INFO (zkCallback-6282-thread-2-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253680 INFO (zkCallback-6282-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1253782 INFO (OverseerStateUpdate-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"halfcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35377/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1253790 INFO (OverseerStateUpdate-99233231186624524-127.0.0.1:41503_solr-n_0000000000) [n:127.0.0.1:41503_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"halfcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"halfcollection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46357/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1253987 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica_n2&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1253987 INFO (qtp2489907-20658) [n:127.0.0.1:35377_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica_n1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1253987 WARN (qtp2489907-20658) [n:127.0.0.1:35377_solr ] o.a.s.c.CoreContainer Creating a core with existing name is not allowed
[junit4] 2> 1253988 ERROR (qtp2489907-20658) [n:127.0.0.1:35377_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica_n1' already exists.
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:932)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1253988 INFO (qtp2489907-20658) [n:127.0.0.1:35377_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica_n1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=500 QTime=1
[junit4] 2> 1253988 ERROR (qtp2489907-20658) [n:127.0.0.1:35377_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica_n1' already exists.
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:932)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1253989 ERROR (OverseerThreadFactory-6061-thread-5-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:35377/solr
[junit4] 2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35377/solr: Core with name 'halfcollection_shard1_replica_n1' already exists.
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1254090 INFO (zkCallback-6282-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1254090 INFO (zkCallback-6282-thread-2-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1254996 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1255004 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.s.IndexSchema [halfcollection_shard2_replica_n2] Schema name=minimal
[junit4] 2> 1255006 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1255006 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard2_replica_n2' using configuration from collection halfcollection, trusted=true
[junit4] 2> 1255006 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollection.shard2.replica_n2' (registry 'solr.core.halfcollection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1041e4d
[junit4] 2> 1255006 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1255006 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SolrCore [[halfcollection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node1/halfcollection_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_75FD759AB367EB30-001/tempDir-001/node1/halfcollection_shard2_replica_n2/data/]
[junit4] 2> 1255065 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1255065 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1255066 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1255066 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1255068 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@b3f39d[halfcollection_shard2_replica_n2] main]
[junit4] 2> 1255068 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1255068 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1255069 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1255070 INFO (searcherExecutor-6080-thread-1-processing-n:127.0.0.1:46357_solr x:halfcollection_shard2_replica_n2 s:shard2 c:halfcollection r:core_node4) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SolrCore [halfcollection_shard2_replica_n2] Registered new searcher Searcher@b3f39d[halfcollection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1255070 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587731702280617984
[junit4] 2> 1255072 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1255072 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1255072 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46357/solr/halfcollection_shard2_replica_n2/
[junit4] 2> 1255072 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1255073 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:46357/solr/halfcollection_shard2_replica_n2/ has no replicas
[junit4] 2> 1255073 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1255074 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46357/solr/halfcollection_shard2_replica_n2/ shard2
[junit4] 2> 1255175 INFO (zkCallback-6282-thread-1-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1255175 INFO (zkCallback-6282-thread-2-processing-n:127.0.0.1:46357_solr) [n:127.0.0.1:46357_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1255224 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1255225 INFO (qtp8056611-20661) [n:127.0.0.1:46357_solr c:halfcollection s:shard2 r:core_node4 x:halfcollection_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica_n2&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1238
[junit4] 2> 1255226 ERROR (OverseerThreadFactory-6061-thread-5-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [halfcollection].
[junit4] 2> 1255226 INFO (OverseerThreadFactory-6061-thread-5-processing-n:127.0.0.1:41503_solr) [n:127.0.0.1:41503_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1255227 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollection.shard2.replica_n2, tag=null
[junit4] 2> 1255227 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b01b05: rootName = null, domain = solr.core.halfcollection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.halfcollection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@17db70d
[junit4] 2> 1255236 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.c.SolrCore [halfcollection_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@bbf843
[junit4] 2> 1255236 INFO (qtp8056611-20659) [n:127.0.0.1:46357_solr ] o.a.s.m.SolrMetricManag
[...truncated too long message...]
e #############################################
[junit4] 2>
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 0
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 2
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10014_solr
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10015_solr
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testNodeLost]
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testNodeLost 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 3
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 3
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - AFTER_ACTION 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - BEFORE_ACTION 1
[junit4] 2> 2739440 INFO (TEST-TestComputePlanAction.testNodeLost-seed#[75FD759AB367EB30]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 1
[junit4] 2> 2739441 DEBUG (AutoscalingActionExecutor-8931-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 141 ms for event id=7283243bd6c43T7bki6w50czoolmpfc0iic4wgd
[junit4] 2> 2739441 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2739441 DEBUG (SUITE-TestComputePlanAction-seed#[75FD759AB367EB30]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestComputePlanAction_75FD759AB367EB30-001
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=31375, maxDocsPerChunk=6, blockSize=644), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=31375, blockSize=644)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1ce926b), locale=th-TH, timezone=America/North_Dakota/New_Salem
[junit4] 2> NOTE: Linux 4.10.0-40-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=183134160,total=463073280
[junit4] 2> NOTE: All tests run in this JVM: [UpdateLogTest, TestSolrCloudWithSecureImpersonation, TestNodeLostTrigger, TestDistributedSearch, RuleEngineTest, SyncSliceTest, TestLeaderInitiatedRecoveryThread, V2StandaloneTest, HdfsCollectionsAPIDistributedZkTest, TestStressLiveNodes, SearchHandlerTest, CacheHeaderTest, SmileWriterTest, CdcrRequestHandlerTest, TestPayloadScoreQParserPlugin, BadCopyFieldTest, SolrMetricManagerTest, LeaderInitiatedRecoveryOnCommitTest, TestCSVLoader, SolrPluginUtilsTest, AtomicUpdateProcessorFactoryTest, URLClassifyProcessorTest, TestConfigSetsAPIZkFailure, DistributedQueryComponentOptimizationTest, JsonLoaderTest, TestRuleBasedAuthorizationPlugin, DistributedDebugComponentTest, TestChildDocTransformer, TestSubQueryTransformerDistrib, TestRandomFaceting, CoreSorterTest, TestRequestForwarding, TestSchemaNameResource, TestRawTransformer, UpdateRequestProcessorFactoryTest, NodeLostTriggerTest, CurrencyFieldTypeTest, TestShardHandlerFactory, TestMergePolicyConfig, RAMDirectoryFactoryTest, TestTolerantUpdateProcessorRandomCloud, TestDynamicLoading, TestFileDictionaryLookup, TestStressVersions, ResourceLoaderTest, TestReplicationHandler, ZkStateReaderTest, TestDistribIDF, HdfsDirectoryFactoryTest, TestPullReplica, SimpleFacetsTest, ZkControllerTest, CdcrBootstrapTest, TestCollectionAPIs, ExternalFileFieldSortTest, EnumFieldTest, SolrShardReporterTest, BasicZkTest, UninvertDocValuesMergePolicyTest, SegmentsInfoRequestHandlerTest, ResponseLogComponentTest, SpatialHeatmapFacetsTest, TestConfigSets, LeaderElectionIntegrationTest, TestHashQParserPlugin, RequestLoggingTest, TestConfigOverlay, TestSort, SliceStateTest, MinimalSchemaTest, TestBadConfig, FastVectorHighlighterTest, TestHdfsCloudBackupRestore, MultiTermTest, TestFieldResource, SpatialFilterTest, TestMaxScoreQueryParser, TestManagedStopFilterFactory, BasicDistributedZkTest, TestMaxTokenLenTokenizer, TestCloudDeleteByQuery, FileUtilsTest, TestFieldCache, HighlighterMaxOffsetTest, SolrIndexMetricsTest, TestSmileRequest, BasicFunctionalityTest, SpellCheckComponentTest, TestInitParams, TestSweetSpotSimilarityFactory, CursorPagingTest, TestReversedWildcardFilterFactory, ActionThrottleTest, SpellCheckCollatorWithCollapseTest, SortSpecParsingTest, UpdateParamsTest, AutoAddReplicasIntegrationTest, TestMiniSolrCloudClusterSSL, BitVectorTest, TestHighlightDedupGrouping, DocExpirationUpdateProcessorFactoryTest, TestSegmentSorting, TestGenericDistributedQueue, ComputePlanActionTest, TermVectorComponentTest, HLLSerializationTest, TestSuggestSpellingConverter, TestPerFieldSimilarityWithDefaultOverride, TriLevelCompositeIdRoutingTest, TestConfigReload, HdfsRecoveryZkTest, TestIndexingPerformance, TestLegacyTerms, SSLMigrationTest, TestWordDelimiterFilterFactory, TestClassicSimilarityFactory, ReplicationFactorTest, DistributedQueryElevationComponentTest, TestSolrJ, DistributedMLTComponentTest, HdfsWriteToMultipleCollectionsTest, TestDistribDocBasedVersion, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, TestRandomDVFaceting, TestJoin, TestSolr4Spatial, StatsComponentTest, ConvertedLegacyTest, TestFiltering, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SuggesterFSTTest, DocValuesTest, TestUpdate, FieldMutatingUpdateProcessorTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, TestQueryUtils, PrimitiveFieldTypeTest, TestOmitPositions, RequestHandlersTest, DocumentBuilderTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, TestJmxIntegration, MBeansHandlerTest, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, SolrIndexConfigTest, BadComponentTest, SampleTest, TestDocSet, TestBinaryField, TestConfig, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, DOMUtilTest, ClusterStateTest, TestLRUCache, TestUtils, ZkNodePropsTest, UUIDFieldTest, CircularListTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestSimpleTrackingShardHandler, AddReplicaTest, AssignBackwardCompatibilityTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DistribCursorPagingTest, HealthCheckHandlerTest, HttpPartitionTest, MoveReplicaTest, NodeMutatorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, RecoveryAfterSoftCommitTest, RestartWhileUpdatingTest, RollingRestartTest, TestRandomRequestDistribution, TestSkipOverseerOperations, TestStressInPlaceUpdates, HttpTriggerListenerTest, MetricTriggerTest, NodeAddedTriggerTest, TestPolicyCloud, TestClusterStateProvider, TestComputePlanAction]
[junit4] Completed [584/765 (3!)] on J0 in 1.03s, 3 tests, 1 error <<< FAILURES!
[...truncated 44390 lines...]
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build #
21136 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21136/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest.test
Error Message:
Error from server at https://127.0.0.1:37039/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37039/solr: create the collection time out:180s
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:68)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 11909 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsRecoveryZkTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/init-core-data-001
[junit4] 2> 144422 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=981 numCloses=981
[junit4] 2> 144422 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 144423 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 144424 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 144425 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-001
[junit4] 2> 144425 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 144430 INFO (Thread-479) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 144430 INFO (Thread-479) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 144432 ERROR (Thread-479) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 144530 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:39127
[junit4] 2> 144531 INFO (zkConnectionManagerCallback-356-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144534 INFO (jetty-launcher-353-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 144534 INFO (jetty-launcher-353-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 144534 INFO (jetty-launcher-353-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64fd0e74{/solr,null,AVAILABLE}
[junit4] 2> 144534 INFO (jetty-launcher-353-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39cf284f{/solr,null,AVAILABLE}
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1ee370a2{SSL,[ssl, http/1.1]}{127.0.0.1:40327}
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5dffc501{SSL,[ssl, http/1.1]}{127.0.0.1:37039}
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-1) [ ] o.e.j.s.Server Started @146416ms
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-2) [ ] o.e.j.s.Server Started @146416ms
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37039}
[junit4] 2> 144536 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40327}
[junit4] 2> 144537 ERROR (jetty-launcher-353-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 144537 ERROR (jetty-launcher-353-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T00:56:39.799186Z
[junit4] 2> 144537 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-12-25T00:56:39.799199Z
[junit4] 2> 144538 INFO (zkConnectionManagerCallback-359-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144538 INFO (zkConnectionManagerCallback-360-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144538 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 144538 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 144542 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608b2bec0d0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 144544 INFO (jetty-launcher-353-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39127/solr
[junit4] 2> 144544 INFO (jetty-launcher-353-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39127/solr
[junit4] 2> 144545 INFO (zkConnectionManagerCallback-366-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144545 INFO (zkConnectionManagerCallback-368-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144545 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1608b2bec0d0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 144552 INFO (zkConnectionManagerCallback-371-thread-1-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144552 INFO (zkConnectionManagerCallback-372-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144597 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 144597 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 144597 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40327_solr
[junit4] 2> 144597 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.c.Overseer Overseer (id=99232212562280454-127.0.0.1:40327_solr-n_0000000000) starting
[junit4] 2> 144602 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37039_solr
[junit4] 2> 144610 INFO (zkCallback-370-thread-1-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 144621 INFO (OverseerStateUpdate-99232212562280454-127.0.0.1:40327_solr-n_0000000000) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 144621 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40327_solr
[junit4] 2> 144622 INFO (zkCallback-370-thread-1-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 144622 INFO (zkCallback-369-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 144667 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37039.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144668 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40327.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144671 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37039.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144671 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37039.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144672 INFO (jetty-launcher-353-thread-2) [n:127.0.0.1:37039_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-001/node2/.
[junit4] 2> 144673 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40327.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144673 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40327.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 144674 INFO (jetty-launcher-353-thread-1) [n:127.0.0.1:40327_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-001/node1/.
[junit4] 2> 144700 INFO (zkConnectionManagerCallback-378-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144707 INFO (zkConnectionManagerCallback-382-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 144707 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 144708 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39127/solr ready
[junit4] 2> 144970 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 145307 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 145423 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 145438 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 145658 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log jetty-6.1.x
[junit4] 2> 145697 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_40125_hdfs____2jfh1u/webapp
[junit4] 2> 145831 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:40125
[junit4] 2> 146195 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 146197 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log jetty-6.1.x
[junit4] 2> 146200 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41529_datanode____.22eu4a/webapp
[junit4] 2> 146275 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41529
[junit4] 2> 146288 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] i.n.u.i.PlatformDependent Your platform does not provide complete low-level API for accessing direct buffers reliably. Unless explicitly requested, heap buffer will always be preferred to avoid potential system unstability.
[junit4] 2> 146458 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 146459 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log jetty-6.1.x
[junit4] 2> 146461 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44931_datanode____vrb3ni/webapp
[junit4] 2> 146531 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44931
[junit4] 2> 146842 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 146842 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 146907 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x69fcb02b9f9cd: from storage DS-79e2d2b2-a32e-4079-98f4-c34be3c3dc2f node DatanodeRegistration(127.0.0.1:35801, datanodeUuid=7b539c81-1dac-4944-ba7e-aff6280c59ab, infoPort=38619, infoSecurePort=0, ipcPort=37667, storageInfo=lv=-56;cid=testClusterID;nsid=809974124;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 146908 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x69fcb02b9f9c9: from storage DS-cb72df5d-5e7c-4f90-babf-c4561d637bf6 node DatanodeRegistration(127.0.0.1:34399, datanodeUuid=ad074e9a-ea84-4023-81ea-b106e17cd8a7, infoPort=36139, infoSecurePort=0, ipcPort=33291, storageInfo=lv=-56;cid=testClusterID;nsid=809974124;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 146908 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x69fcb02b9f9cd: from storage DS-42a3c5e3-5200-40c2-9567-9cad09c66eb3 node DatanodeRegistration(127.0.0.1:35801, datanodeUuid=7b539c81-1dac-4944-ba7e-aff6280c59ab, infoPort=38619, infoSecurePort=0, ipcPort=37667, storageInfo=lv=-56;cid=testClusterID;nsid=809974124;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 146908 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x69fcb02b9f9c9: from storage DS-974f0e1b-5fb7-4aa5-a151-ab3e6f6cf7a0 node DatanodeRegistration(127.0.0.1:34399, datanodeUuid=ad074e9a-ea84-4023-81ea-b106e17cd8a7, infoPort=36139, infoSecurePort=0, ipcPort=33291, storageInfo=lv=-56;cid=testClusterID;nsid=809974124;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 147089 INFO (TEST-HdfsRecoveryZkTest.test-seed#[C74E5222160E9DB9]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 147105 INFO (qtp1022035898-1760) [n:127.0.0.1:37039_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=recoverytest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 147106 INFO (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.CreateCollectionCmd Create collection recoverytest
[junit4] 2> 147216 INFO (OverseerStateUpdate-99232212562280454-127.0.0.1:40327_solr-n_0000000000) [n:127.0.0.1:40327_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"recoverytest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"recoverytest_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37039/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 147218 INFO (OverseerStateUpdate-99232212562280454-127.0.0.1:40327_solr-n_0000000000) [n:127.0.0.1:40327_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"recoverytest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"recoverytest_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:40327/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 147426 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n1&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 147426 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 147435 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n2&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 147435 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 147537 INFO (zkCallback-369-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 147537 INFO (zkCallback-370-thread-1-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 147538 INFO (zkCallback-369-thread-2-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 147538 INFO (zkCallback-370-thread-2-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/recoverytest/state.json] for collection [recoverytest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 148456 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 148463 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.IndexSchema [recoverytest_shard1_replica_n1] Schema name=minimal
[junit4] 2> 148464 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 148466 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 148466 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'recoverytest_shard1_replica_n1' using configuration from collection recoverytest, trusted=true
[junit4] 2> 148467 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37039.solr.core.recoverytest.shard1.replica_n1' (registry 'solr.core.recoverytest.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 148474 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.IndexSchema [recoverytest_shard1_replica_n2] Schema name=minimal
[junit4] 2> 148478 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 148478 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'recoverytest_shard1_replica_n2' using configuration from collection recoverytest, trusted=true
[junit4] 2> 148479 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40327.solr.core.recoverytest.shard1.replica_n2' (registry 'solr.core.recoverytest.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5720bb44
[junit4] 2> 148480 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:37671/data
[junit4] 2> 148480 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:37671/data
[junit4] 2> 148480 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 148480 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 148480 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 148480 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 148480 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrCore [[recoverytest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-001/node1/recoverytest_shard1_replica_n2], dataDir=[hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data/]
[junit4] 2> 148480 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore [[recoverytest_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-001/node2/recoverytest_shard1_replica_n1], dataDir=[hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data/]
[junit4] 2> 148483 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data/snapshot_metadata
[junit4] 2> 148484 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data/snapshot_metadata
[junit4] 2> 148501 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 148501 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 148502 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
[junit4] 2> 148504 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 148504 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 148538 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 148539 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 148546 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data
[junit4] 2> 148546 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data
[junit4] 2> 148572 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data/index
[junit4] 2> 148577 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data/index
[junit4] 2> 148807 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 148807 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 148824 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 148837 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
[junit4] 2> 148837 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [16777216] will allocate [1] slabs and use ~[16777216] bytes
[junit4] 2> 148842 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.b.BlockDirectory Block cache on write is disabled
[junit4] 2> 149023 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35801 is added to blk_1073741826_1002{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-cb72df5d-5e7c-4f90-babf-c4561d637bf6:NORMAL:127.0.0.1:34399|RBW], ReplicaUC[[DISK]DS-42a3c5e3-5200-40c2-9567-9cad09c66eb3:NORMAL:127.0.0.1:35801|RBW]]} size 69
[junit4] 2> 149024 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34399 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-42a3c5e3-5200-40c2-9567-9cad09c66eb3:NORMAL:127.0.0.1:35801|RBW], ReplicaUC[[DISK]DS-974f0e1b-5fb7-4aa5-a151-ab3e6f6cf7a0:NORMAL:127.0.0.1:34399|RBW]]} size 69
[junit4] 2> 149024 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:35801 is added to blk_1073741825_1001 size 69
[junit4] 2> 149024 INFO (Block report processor) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34399 is added to blk_1073741826_1002 size 69
[junit4] 2> 149475 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 149475 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 149475 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 149485 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 149485 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 149487 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 149487 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 149487 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
[junit4] 2> 149501 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 149502 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 149582 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e839dcf[recoverytest_shard1_replica_n1] main]
[junit4] 2> 149583 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3dff5c76[recoverytest_shard1_replica_n2] main]
[junit4] 2> 149584 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 149585 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 149586 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 149587 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 149587 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 149587 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 149611 INFO (searcherExecutor-778-thread-1-processing-n:127.0.0.1:40327_solr x:recoverytest_shard1_replica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrCore [recoverytest_shard1_replica_n2] Registered new searcher Searcher@3dff5c76[recoverytest_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 149612 INFO (searcherExecutor-777-thread-1-processing-n:127.0.0.1:37039_solr x:recoverytest_shard1_replica_n1 s:shard1 c:recoverytest r:core_node3) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore [recoverytest_shard1_replica_n1] Registered new searcher Searcher@1e839dcf[recoverytest_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 149614 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587715406431256576
[junit4] 2> 149614 INFO (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1587715406431256576
[junit4] 2> 149620 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 150120 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 150120 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 150120 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40327/solr/recoverytest_shard1_replica_n2/
[junit4] 2> 150121 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=recoverytest_shard1_replica_n2 url=https://127.0.0.1:40327/solr START replicas=[https://127.0.0.1:37039/solr/recoverytest_shard1_replica_n1/] nUpdates=100
[junit4] 2> 150124 INFO (qtp1022035898-2053) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.S.Request [recoverytest_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 150421 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=recoverytest_shard1_replica_n2 url=https://127.0.0.1:40327/solr DONE. We have no versions. sync failed.
[junit4] 2> 150421 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 150421 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 150421 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 150423 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40327/solr/recoverytest_shard1_replica_n2/ shard1
[junit4] 2> 327113 ERROR (qtp1022035898-1760) [n:127.0.0.1:37039_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> 327113 INFO (qtp1022035898-1760) [n:127.0.0.1:37039_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=recoverytest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=500 QTime=180008
[junit4] 2> 327116 ERROR (qtp1022035898-1760) [n:127.0.0.1:37039_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> 327117 INFO (TEST-HdfsRecoveryZkTest.test-seed#[C74E5222160E9DB9]) [ ] o.a.s.SolrTestCaseJ4 ###Ending test
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsRecoveryZkTest -Dtests.method=test -Dtests.seed=C74E5222160E9DB9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=uk -Dtests.timezone=SystemV/AST4ADT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 180s J0 | HdfsRecoveryZkTest.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37039/solr: create the collection time out:180s
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:68)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)Throwable #2: java.lang.NullPointerException
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.stopThreads(RecoveryZkTest.java:55)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 327121 ERROR (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40327/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:40327/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40327 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 327122 INFO (jetty-closer-354-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1ee370a2{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 327122 INFO (jetty-closer-354-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5dffc501{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 327122 ERROR (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:37039/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:37039/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:37039 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 327123 INFO (jetty-closer-354-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=837742726
[junit4] 2> 327124 ERROR (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [recoverytest].
[junit4] 2> 327124 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 327124 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@222a6401: rootName = solr_37039, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@108d71e7
[junit4] 2> 327123 INFO (jetty-closer-354-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=327865521
[junit4] 2> 327124 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 327124 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4915fce3: rootName = solr_40327, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1202e0d1
[junit4] 2> 327126 INFO (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 327127 ERROR (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40327/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:40327/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:40327 [/127.0.0.1] failed: Connection refused (Connection refused)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
[junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
[junit4] 2> at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
[junit4] 2> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
[junit4] 2> at java.base/java.net.Socket.connect(Socket.java:591)
[junit4] 2> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
[junit4] 2> ... 22 more
[junit4] 2> 327130 ERROR (OverseerThreadFactory-772-thread-1-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:37039/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:37039/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:37039 [/127.0.0.1] failed: Connection refused (Connection refused)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
[junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
[junit4] 2> at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
[junit4] 2> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
[junit4] 2> at java.base/java.net.Socket.connect(Socket.java:591)
[junit4] 2> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
[junit4] 2> ... 22 more
[junit4] 2> 327173 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 327173 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@75b0da04: rootName = solr_40327, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@f64bfca
[junit4] 2> 327174 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 327174 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@47e19fa5: rootName = solr_37039, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@f64bfca
[junit4] 2> 327178 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 327178 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1df72b7b: rootName = solr_37039, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ecfa137
[junit4] 2> 327180 INFO (jetty-closer-354-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37039_solr
[junit4] 2> 327180 INFO (zkCallback-369-thread-4-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 327181 INFO (jetty-closer-354-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 327181 INFO (zkCallback-370-thread-3-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 327194 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.SolrCore [recoverytest_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@64daa742
[junit4] 2> 327194 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.recoverytest.shard1.replica_n1, tag=1692051266
[junit4] 2> 327194 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7d3f7c5b: rootName = solr_37039, domain = solr.core.recoverytest.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.recoverytest.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@75f3c2a9
[junit4] 2> 327195 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 327195 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3759d36a: rootName = solr_40327, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ecfa137
[junit4] 2> 327196 INFO (jetty-closer-354-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40327_solr
[junit4] 2> 327197 INFO (zkCallback-369-thread-4-processing-n:127.0.0.1:40327_solr) [n:127.0.0.1:40327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 327197 INFO (jetty-closer-354-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 327198 INFO (zkCallback-370-thread-3-processing-n:127.0.0.1:37039_solr) [n:127.0.0.1:37039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 327202 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrCore [recoverytest_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@ca44fe
[junit4] 2> 327202 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.recoverytest.shard1.replica_n2, tag=13255934
[junit4] 2> 327202 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e34a74e: rootName = solr_40327, domain = solr.core.recoverytest.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.recoverytest.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@7c9b35a6
[junit4] 2> 327216 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.recoverytest.shard1.leader, tag=1692051266
[junit4] 2> 327234 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.recoverytest.shard1.leader, tag=13255934
[junit4] 2> 327272 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data/snapshot_metadata
[junit4] 2> 327276 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data/index
[junit4] 2> 327286 INFO (coreCloseExecutor-788-thread-1) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node4/data
[junit4] 2> 327290 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data/index
[junit4] 2> 327294 INFO (jetty-closer-354-thread-2) [ ] o.a.s.c.Overseer Overseer (id=99232212562280454-127.0.0.1:40327_solr-n_0000000000) closing
[junit4] 2> 327296 INFO (OverseerStateUpdate-99232212562280454-127.0.0.1:40327_solr-n_0000000000) [n:127.0.0.1:40327_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40327_solr
[junit4] 2> 327294 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data
[junit4] 2> 327297 INFO (coreCloseExecutor-787-thread-1) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:37671/data/recoverytest/core_node3/data/snapshot_metadata
[junit4] 2> 327311 INFO (jetty-closer-354-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@39cf284f{/solr,null,UNAVAILABLE}
[junit4] 2> 327312 ERROR (OldIndexDirectoryCleanupThreadForCore-recoverytest_shard1_replica_n2) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Error checking for old index directories to clean-up.
[junit4] 2> java.io.IOException: Filesystem closed
[junit4] 2> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:808)
[junit4] 2> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:2083)
[junit4] 2> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:2069)
[junit4] 2> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:791)
[junit4] 2> at org.apache.hadoop.hdfs.DistributedFileSystem.access$700(DistributedFileSystem.java:106)
[junit4] 2> at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:853)
[junit4] 2> at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:849)
[junit4] 2> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
[junit4] 2> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:860)
[junit4] 2> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1517)
[junit4] 2> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1557)
[junit4] 2> at org.apache.solr.core.HdfsDirectoryFactory.cleanupOldIndexDirectories(HdfsDirectoryFactory.java:541)
[junit4] 2> at org.apache.solr.core.SolrCore.lambda$cleanupOldIndexDirectories$21(SolrCore.java:3037)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 327314 ERROR (qtp1022035898-1762) [n:127.0.0.1:37039_solr c:recoverytest s:shard1 r:core_node3 x:recoverytest_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
[junit4] 2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: recoverytest slice: shard1 saw state=DocCollection(recoverytest//collections/recoverytest/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"recoverytest_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:37039/solr",
[junit4] 2> "node_name":"127.0.0.1:37039_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"recoverytest_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:40327/solr",
[junit4] 2> "node_name":"127.0.0.1:40327_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0"} with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:892)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1053)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:954)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.Htt
[...truncated too long message...]
chFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: recoverytest slice: shard1 saw state=null with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> ... 44 more
[junit4] 2>
[junit4] 2> 357215 INFO (qtp306554151-1759) [n:127.0.0.1:40327_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=recoverytest_shard1_replica_n2&action=CREATE&numShards=1&collection=recoverytest&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=209779
[junit4] 2> 357215 ERROR (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 357215 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39127 39127
[junit4] 2> 362365 INFO (Thread-479) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39127 39127
[junit4] 2> 362366 WARN (Thread-479) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/recoverytest/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> 362368 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 362387 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 362488 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
[junit4] 2> 362488 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-387348421-88.99.242.108-1514163400396 (Datanode Uuid ad074e9a-ea84-4023-81ea-b106e17cd8a7) service to localhost.localdomain/127.0.0.1:37671
[junit4] 2> 362491 WARN (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 362502 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 362603 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
[junit4] 2> 362604 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:37671) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-387348421-88.99.242.108-1514163400396 (Datanode Uuid 7b539c81-1dac-4944-ba7e-aff6280c59ab) service to localhost.localdomain/127.0.0.1:37671
[junit4] 2> 362613 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
[junit4] 2> 362727 INFO (SUITE-HdfsRecoveryZkTest-seed#[C74E5222160E9DB9]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39127 39127
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsRecoveryZkTest_C74E5222160E9DB9-001
[junit4] 2> Dec 25, 2017 1:00:18 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 66 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=636, maxMBSortInHeap=7.419630988820952, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7df943b4), locale=uk, timezone=SystemV/AST4ADT
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=5,free=206385032,total=433061888
[junit4] 2> NOTE: All tests run in this JVM: [TestLuceneIndexBackCompat, SliceStateTest, SyncSliceTest, TestConfigOverlay, ResourceLoaderTest, TestComponentsName, SharedFSAutoReplicaFailoverTest, TestTrieFacet, TestMiniSolrCloudClusterSSL, TestSolrDeletionPolicy1, TestMergePolicyConfig, ExternalFileFieldSortTest, TestCSVLoader, ResponseLogComponentTest, TestLRUStatsCache, SimpleFacetsTest, BlockCacheTest, TestRandomFaceting, HdfsRecoveryZkTest]
[junit4] Completed [74/765 (1!)] on J0 in 228.17s, 1 test, 1 error <<< FAILURES!
[...truncated 43141 lines...]