You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/04 21:45:38 UTC
[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build #
21572 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21572/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
Error Message:
Timeout waiting for active collection null Live Nodes: [127.0.0.1:33427_solr, 127.0.0.1:36805_solr, 127.0.0.1:37845_solr, 127.0.0.1:39999_solr] Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={ "pullReplicas":"0", "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node62":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61", "base_url":"https://127.0.0.1:37845/solr", "node_name":"127.0.0.1:37845_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node64":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63", "base_url":"https://127.0.0.1:33427/solr", "node_name":"127.0.0.1:33427_solr", "state":"down", "type":"NRT"}, "core_node66":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65", "base_url":"https://127.0.0.1:39999/solr", "node_name":"127.0.0.1:39999_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timeout waiting for active collection
null
Live Nodes: [127.0.0.1:33427_solr, 127.0.0.1:36805_solr, 127.0.0.1:37845_solr, 127.0.0.1:39999_solr]
Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={
"pullReplicas":"0",
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node62":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61",
"base_url":"https://127.0.0.1:37845/solr",
"node_name":"127.0.0.1:37845_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node64":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63",
"base_url":"https://127.0.0.1:33427/solr",
"node_name":"127.0.0.1:33427_solr",
"state":"down",
"type":"NRT"},
"core_node66":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65",
"base_url":"https://127.0.0.1:39999/solr",
"node_name":"127.0.0.1:39999_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([7F4947079F714EA4:57DCD5524CFC9FFF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestCloudConsistency.addDocToWhenOtherReplicasAreDown(TestCloudConsistency.java:164)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:122)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart(TestCloudConsistency.java:95)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 14043 lines...]
[junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/init-core-data-001
[junit4] 2> 1637831 WARN (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=31 numCloses=31
[junit4] 2> 1637831 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1637832 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1637833 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1637833 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001
[junit4] 2> 1637833 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1637833 INFO (Thread-4423) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1637833 INFO (Thread-4423) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1637837 ERROR (Thread-4423) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1637933 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41151
[junit4] 2> 1637935 INFO (zkConnectionManagerCallback-2853-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637939 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1637939 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1637939 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1637939 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1637954 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1637957 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1313577{/solr,null,AVAILABLE}
[junit4] 2> 1637958 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1637958 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d6d0a{/solr,null,AVAILABLE}
[junit4] 2> 1637958 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@288a7e{/solr,null,AVAILABLE}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1674ddf{/solr,null,AVAILABLE}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@e8467{SSL,[ssl, http/1.1]}{127.0.0.1:38719}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@70491f{SSL,[ssl, http/1.1]}{127.0.0.1:33657}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-2) [ ] o.e.j.s.Server Started @1639548ms
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-3) [ ] o.e.j.s.Server Started @1639548ms
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38719}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33657}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@137e665{SSL,[ssl, http/1.1]}{127.0.0.1:35675}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.e.j.s.Server Started @1639548ms
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35675}
[junit4] 2> 1637961 ERROR (jetty-launcher-2850-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1dfc88d{SSL,[ssl, http/1.1]}{127.0.0.1:40727}
[junit4] 2> 1637961 ERROR (jetty-launcher-2850-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-1) [ ] o.e.j.s.Server Started @1639548ms
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40727}
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1637961 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.498Z
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1637961 ERROR (jetty-launcher-2850-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.498Z
[junit4] 2> 1637961 ERROR (jetty-launcher-2850-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.498Z
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1637962 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.498Z
[junit4] 2> 1637969 INFO (zkConnectionManagerCallback-2855-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637970 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1637970 INFO (zkConnectionManagerCallback-2857-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637970 INFO (zkConnectionManagerCallback-2859-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637970 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1637970 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1637980 INFO (zkConnectionManagerCallback-2861-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637980 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1637985 INFO (jetty-launcher-2850-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1637985 INFO (jetty-launcher-2850-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1637985 INFO (jetty-launcher-2850-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1637986 INFO (jetty-launcher-2850-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1637989 INFO (zkConnectionManagerCallback-2869-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637989 INFO (zkConnectionManagerCallback-2871-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637989 INFO (zkConnectionManagerCallback-2877-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637989 INFO (zkConnectionManagerCallback-2875-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637990 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1001406f5d00007, likely client has closed socket
[junit4] 2> 1637990 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1001406f5d00006, likely client has closed socket
[junit4] 2> 1637990 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1001406f5d00008, likely client has closed socket
[junit4] 2> 1637990 INFO (zkConnectionManagerCallback-2879-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637990 INFO (zkConnectionManagerCallback-2882-thread-1-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637991 INFO (zkConnectionManagerCallback-2883-thread-1-processing-n:127.0.0.1:33657_solr) [n:127.0.0.1:33657_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1637991 INFO (zkConnectionManagerCallback-2885-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38719_solr
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33657_solr
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35675_solr
[junit4] 2> 1638027 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40727_solr
[junit4] 2> 1638028 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.c.Overseer Overseer (id=72079614164336649-127.0.0.1:38719_solr-n_0000000000) starting
[junit4] 2> 1638036 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638036 INFO (zkCallback-2884-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638037 INFO (zkCallback-2880-thread-1-processing-n:127.0.0.1:33657_solr) [n:127.0.0.1:33657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638036 INFO (zkCallback-2881-thread-1-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638051 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38719_solr
[junit4] 2> 1638051 INFO (zkCallback-2880-thread-1-processing-n:127.0.0.1:33657_solr) [n:127.0.0.1:33657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638051 INFO (zkCallback-2881-thread-1-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638053 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638057 INFO (zkCallback-2884-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638101 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33657.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638109 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33657.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638109 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33657.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638110 INFO (jetty-launcher-2850-thread-3) [n:127.0.0.1:33657_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node3/.
[junit4] 2> 1638115 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40727.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638122 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40727.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638122 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40727.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638123 INFO (jetty-launcher-2850-thread-1) [n:127.0.0.1:40727_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node1/.
[junit4] 2> 1638190 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35675.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638197 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35675.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638198 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35675.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638199 INFO (jetty-launcher-2850-thread-4) [n:127.0.0.1:35675_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node4/.
[junit4] 2> 1638209 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638218 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638218 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38719.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638219 INFO (jetty-launcher-2850-thread-2) [n:127.0.0.1:38719_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node2/.
[junit4] 2> 1638261 INFO (zkConnectionManagerCallback-2895-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638263 INFO (zkConnectionManagerCallback-2899-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638264 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1638265 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41151/solr ready
[junit4] 2> 1638267 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@70491f{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1638267 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=18436692
[junit4] 2> 1638267 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1638267 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1216013: rootName = solr_33657, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ecb327
[junit4] 2> 1638272 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1638272 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@127aa41: rootName = solr_33657, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@97d374
[junit4] 2> 1638276 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1638276 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14f2357: rootName = solr_33657, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a8437e
[junit4] 2> 1638277 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33657_solr
[junit4] 2> 1638277 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1638277 INFO (zkCallback-2884-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638277 INFO (zkCallback-2880-thread-1-processing-n:127.0.0.1:33657_solr) [n:127.0.0.1:33657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638277 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1638278 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638277 INFO (zkCallback-2881-thread-1-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638277 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638278 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d6d0a{/solr,null,UNAVAILABLE}
[junit4] 2> 1638278 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1638279 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a68ec8{/solr,null,AVAILABLE}
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a8b1cf{SSL,[ssl, http/1.1]}{127.0.0.1:36105}
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server Started @1639867ms
[junit4] 2> 1638280 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37845}
[junit4] 2> 1638281 ERROR (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1638281 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1638281 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1638281 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1638281 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.817Z
[junit4] 2> 1638282 INFO (zkConnectionManagerCallback-2901-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638282 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1638289 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1638292 INFO (zkConnectionManagerCallback-2905-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638294 INFO (zkConnectionManagerCallback-2907-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638297 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638297 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638298 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37845_solr
[junit4] 2> 1638299 INFO (zkCallback-2884-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638299 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638299 INFO (zkCallback-2881-thread-2-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638299 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638299 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638357 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37845.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638363 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37845.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638363 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37845.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638364 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:37845_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node3/.
[junit4] 2> 1638395 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:36105/solr. Proxy: https://127.0.0.1:37845/solr
[junit4] 2> 1638396 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1dfc88d{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1638396 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1716945
[junit4] 2> 1638396 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1638396 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fedb62: rootName = solr_40727, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@199720e
[junit4] 2> 1638401 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1638402 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@cd44de: rootName = solr_40727, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@97d374
[junit4] 2> 1638405 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1638405 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a6168: rootName = solr_40727, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a8437e
[junit4] 2> 1638405 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40727_solr
[junit4] 2> 1638406 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1638406 INFO (zkCallback-2881-thread-2-processing-n:127.0.0.1:40727_solr) [n:127.0.0.1:40727_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638406 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638406 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1638406 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638406 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638406 INFO (zkCallback-2884-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638409 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1674ddf{/solr,null,UNAVAILABLE}
[junit4] 2> 1638410 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1638411 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1638411 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1638411 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1638411 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1638411 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1310a6b{/solr,null,AVAILABLE}
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1ee51b6{SSL,[ssl, http/1.1]}{127.0.0.1:43843}
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server Started @1639999ms
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33427}
[junit4] 2> 1638412 ERROR (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1638412 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:53.948Z
[junit4] 2> 1638413 INFO (zkConnectionManagerCallback-2911-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638413 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1638427 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1638428 INFO (zkConnectionManagerCallback-2915-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638429 INFO (zkConnectionManagerCallback-2917-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1638432 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1638432 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1638433 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33427_solr
[junit4] 2> 1638434 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638434 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638434 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638434 INFO (zkCallback-2884-thread-2-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638438 INFO (zkCallback-2916-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1638508 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33427.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638515 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33427.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638515 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33427.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1638516 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:33427_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node1/.
[junit4] 2> 1638546 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:43843/solr. Proxy: https://127.0.0.1:33427/solr
[junit4] 2> 1638547 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@137e665{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1638547 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2534696
[junit4] 2> 1638547 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1638548 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5df57d: rootName = solr_35675, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@c5145f
[junit4] 2> 1638552 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1638552 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@71a014: rootName = solr_35675, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@97d374
[junit4] 2> 1638556 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1638556 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1cf85c1: rootName = solr_35675, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a8437e
[junit4] 2> 1638557 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35675_solr
[junit4] 2> 1638557 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1638557 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638557 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638557 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1638557 INFO (zkCallback-2884-thread-2-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638557 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1638557 INFO (zkCallback-2916-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640058 WARN (zkCallback-2884-thread-2-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:35675_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:35675_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1640058 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1313577{/solr,null,UNAVAILABLE}
[junit4] 2> 1640059 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1640060 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1640061 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1640061 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1640061 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1640061 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b4099{/solr,null,AVAILABLE}
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@880364{SSL,[ssl, http/1.1]}{127.0.0.1:46513}
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server Started @1641649ms
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39999}
[junit4] 2> 1640062 ERROR (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1640062 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:55.598Z
[junit4] 2> 1640065 INFO (zkConnectionManagerCallback-2921-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640065 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1640073 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1640075 INFO (zkConnectionManagerCallback-2925-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640077 INFO (zkConnectionManagerCallback-2927-thread-1-processing-n:127.0.0.1:39999_solr) [n:127.0.0.1:39999_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640080 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1640080 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1640081 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39999_solr
[junit4] 2> 1640082 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640082 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640082 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640082 INFO (zkCallback-2916-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640085 INFO (zkCallback-2926-thread-1-processing-n:127.0.0.1:39999_solr) [n:127.0.0.1:39999_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640139 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39999.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640145 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39999.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640145 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39999.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640146 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:39999_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node4/.
[junit4] 2> 1640176 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:46513/solr. Proxy: https://127.0.0.1:39999/solr
[junit4] 2> 1640177 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@e8467{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1640177 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=28789027
[junit4] 2> 1640177 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1640177 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1e1be91: rootName = solr_38719, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@129dc7d
[junit4] 2> 1640182 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1640182 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a7865: rootName = solr_38719, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@97d374
[junit4] 2> 1640186 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1640186 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15242c7: rootName = solr_38719, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a8437e
[junit4] 2> 1640186 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38719_solr
[junit4] 2> 1640187 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1640187 INFO (zkCallback-2916-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640187 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640187 INFO (zkCallback-2926-thread-1-processing-n:127.0.0.1:39999_solr) [n:127.0.0.1:39999_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640187 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1640187 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640187 INFO (zkCallback-2878-thread-1-processing-n:127.0.0.1:38719_solr) [n:127.0.0.1:38719_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1640187 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.Overseer Overseer (id=72079614164336649-127.0.0.1:38719_solr-n_0000000000) closing
[junit4] 2> 1640187 INFO (OverseerStateUpdate-72079614164336649-127.0.0.1:38719_solr-n_0000000000) [n:127.0.0.1:38719_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38719_solr
[junit4] 2> 1640187 WARN (OverseerAutoScalingTriggerThread-72079614164336649-127.0.0.1:38719_solr-n_0000000000) [n:127.0.0.1:38719_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1640188 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37845_solr
[junit4] 2> 1640188 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@288a7e{/solr,null,UNAVAILABLE}
[junit4] 2> 1640188 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1640189 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.Overseer Overseer (id=72079614164336657-127.0.0.1:37845_solr-n_0000000004) starting
[junit4] 2> 1640190 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1640190 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1640190 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1640190 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1640190 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25bf2f{/solr,null,AVAILABLE}
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@14bb655{SSL,[ssl, http/1.1]}{127.0.0.1:32819}
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.e.j.s.Server Started @1641778ms
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36805}
[junit4] 2> 1640191 ERROR (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1640191 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T21:19:55.727Z
[junit4] 2> 1640192 INFO (zkConnectionManagerCallback-2931-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640192 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1640197 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41151/solr
[junit4] 2> 1640198 INFO (zkConnectionManagerCallback-2935-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640199 INFO (zkConnectionManagerCallback-2937-thread-1-processing-n:127.0.0.1:36805_solr) [n:127.0.0.1:36805_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1640201 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1640202 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1640203 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36805_solr
[junit4] 2> 1640203 INFO (zkCallback-2898-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640203 INFO (zkCallback-2926-thread-1-processing-n:127.0.0.1:39999_solr) [n:127.0.0.1:39999_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640203 INFO (zkCallback-2916-thread-1-processing-n:127.0.0.1:33427_solr) [n:127.0.0.1:33427_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640203 INFO (zkCallback-2906-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640206 INFO (zkCallback-2936-thread-1-processing-n:127.0.0.1:36805_solr) [n:127.0.0.1:36805_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1640265 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36805.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640272 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36805.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640272 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36805.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1832625
[junit4] 2> 1640273 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [n:127.0.0.1:36805_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node2/.
[junit4] 2> 1640309 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:32819/solr. Proxy: https://127.0.0.1:36805/solr
[junit4] 2> 1640330 INFO (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[7F4947079F714EA4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOutOfSyncReplicasCannotBecomeLeader
[junit4] 2> 1640330 INFO (SocketProxy-Acceptor-33427) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38286,localport=33427], receiveBufferSize:531000
[junit4] 2> 1640333 INFO (SocketProxy-Acceptor-33427) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43843,localport=33116], receiveBufferSize=530904
[junit4] 2> 1640395 INFO (qtp30685495-14577) [n:127.0.0.1:33427_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=3&name=outOfSyncReplicasCannotBecomeLeader-false&nrtReplicas=3&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1640396 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection outOfSyncReplicasCannotBecomeLeader-false
[junit4] 2> 1640397 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/protwords.txt
[junit4] 2> 1640397 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/managed-schema
[junit4] 2> 1640398 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/solrconfig.xml
[junit4] 2> 1640399 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/synonyms.txt
[junit4] 2> 1640399 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/stopwords.txt
[junit4] 2> 1640400 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_it.txt
[junit4] 2> 1640401 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stemdict_nl.txt
[junit4] 2> 1640401 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hy.txt
[junit4] 2> 1640402 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_no.txt
[junit4] 2> 1640402 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_ca.txt
[junit4] 2> 1640403 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_id.txt
[junit4] 2> 1640403 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ga.txt
[junit4] 2> 1640403 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hi.txt
[junit4] 2> 1640404 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_da.txt
[junit4] 2> 1640404 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ja.txt
[junit4] 2> 1640405 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_pt.txt
[junit4] 2> 1640406 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hu.txt
[junit4] 2> 1640406 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_el.txt
[junit4] 2> 1640407 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ru.txt
[junit4] 2> 1640407 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_tr.txt
[junit4] 2> 1640408 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ar.txt
[junit4] 2> 1640408 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/userdict_ja.txt
[junit4] 2> 1640409 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_eu.txt
[junit4] 2> 1640409 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_it.txt
[junit4] 2> 1640410 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_cz.txt
[junit4] 2> 1640411 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stoptags_ja.txt
[junit4] 2> 1640411 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_fr.txt
[junit4] 2> 1640412 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_de.txt
[junit4] 2> 1640412 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_fa.txt
[junit4] 2> 1640413 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_ga.txt
[junit4] 2> 1640413 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ca.txt
[junit4] 2> 1640414 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_nl.txt
[junit4] 2> 1640414 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_bg.txt
[junit4] 2> 1640415 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_lv.txt
[junit4] 2> 1640415 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_en.txt
[junit4] 2> 1640416 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_es.txt
[junit4] 2> 1640416 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_th.txt
[junit4] 2> 1640417 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ro.txt
[junit4] 2> 1640417 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_fr.txt
[junit4] 2> 1640418 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_sv.txt
[junit4] 2> 1640418 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_fi.txt
[junit4] 2> 1640419 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/hyphenations_ga.txt
[junit4] 2> 1640419 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_gl.txt
[junit4] 2> 1640420 INFO (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/params.json
[junit4] 2> 1640420 WARN (OverseerThreadFactory-6071-thread-1-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (outOfSyncReplicasCannotBecomeLeader-false) without cores.
[junit4] 2> 1640523 INFO (qtp30685495-14577) [n:127.0.0.1:33427_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1640524 INFO (qtp30685495-14577) [n:127.0.0.1:33427_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=3&name=outOfSyncReplicasCannotBecomeLeader-false&nrtReplicas=3&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=&wt=javabin&version=2} status=0 QTime=128
[junit4] 2> 1640524 INFO (SocketProxy-Acceptor-36805) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=59490,localport=36805], receiveBufferSize:531000
[junit4] 2> 1640526 INFO (SocketProxy-Acceptor-36805) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32819,localport=51952], receiveBufferSize=530904
[junit4] 2> 1640595 INFO (qtp21278917-14633) [n:127.0.0.1:36805_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37845_solr&action=ADDREPLICA&collection=outOfSyncReplicasCannotBecomeLeader-false&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1640596 INFO (OverseerCollectionConfigSetProcessor-72079614164336657-127.0.0.1:37845_solr-n_0000000004) [n:127.0.0.1:37845_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1640597 INFO (OverseerThreadFactory-6071-thread-2-processing-n:127.0.0.1:37845_solr) [n:127.0.0.1:37845_solr ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:37845_solr for creating new replica
[junit4] 2> 1640599 INFO (OverseerStateUpdate-72079614164336657-127.0.0.1:37845_solr-n_0000000004) [n:127.0.0.1:37845_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"outOfSyncReplicasCannotBecomeLeader-false",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37845/solr",
[junit4] 2> "node_name":"127.0.0.1:37845_solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 1640800 INFO (SocketProxy-Acceptor-37845) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=34188,localport=37845], receiveBufferSize:531000
[junit4] 2> 1640800 INFO (SocketProxy-Acceptor-37845) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36105,localport=56040], receiveBufferSize=530904
[junit4] 2> 1640906 INFO (qtp29290521-14550) [n:127.0.0.1:37845_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node62&collection.configName=outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED&name=outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61&action=CREATE&collection=outOfSyncReplicasCannotBecomeLeader-false&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1640907 INFO (qtp29290521-14550) [n:127.0.0.1:37845_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1640914 INFO (qtp29290521-14550) [n:127.0.0.1:37845_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node62 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 1640914 INFO (qtp29290521-14550) [n:127.0.0.1:37845_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node62 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 1640914 WARN (qtp29290521-14550) [n:127.0.0.1:37845_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node62 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node3/outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001/tempDir-001/node3/outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n61/../../../../contrib/extraction/lib
[junit4] 2> 1640915 WARN (qtp29290521-14550) [n:127.0
[...truncated too long message...]
.1:39999_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:39999_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.RecoveryStrategy Stopping recovery for core=[outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] coreNodeName=[core_node66]
[junit4] 2> 1845339 INFO (jetty-closer-2851-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@14d4595{/solr,null,UNAVAILABLE}
[junit4] 2> 1845339 INFO (jetty-closer-2851-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1845340 ERROR (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1845340 INFO (SUITE-TestCloudConsistency-seed#[7F4947079F714EA4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41151 41151
[junit4] 2> 1846231 INFO (Thread-4423) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41151 41151
[junit4] 2> 1846232 WARN (Thread-4423) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/terms/shard1
[junit4] 2> 27 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/terms/shard1
[junit4] 2> 13 /solr/aliases.json
[junit4] 2> 12 /solr/security.json
[junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED
[junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-schema
[junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/managed-schema
[junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 62 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/state.json
[junit4] 2> 58 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/state.json
[junit4] 2> 13 /solr/clusterprops.json
[junit4] 2> 13 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 4 /solr/overseer_elect/election/72079614164336649-127.0.0.1:38719_solr-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72079614164336666-127.0.0.1:36805_solr-n_0000000007
[junit4] 2> 2 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/leader_elect/shard1/election/72079614164336669-core_node62-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 13 /solr/collections
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_7F4947079F714EA4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@15df3d7), locale=ro, timezone=US/East-Indiana
[junit4] 2> NOTE: Linux 4.13.0-36-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=257258840,total=500170752
[junit4] 2> NOTE: All tests run in this JVM: [PeerSyncWithIndexFingerprintCachingTest, PluginInfoTest, MigrateRouteKeyTest, TestImplicitCoreProperties, SolrIndexConfigTest, CustomHighlightComponentTest, OverseerCollectionConfigSetProcessorTest, BadIndexSchemaTest, CursorMarkTest, TestGroupingSearch, DocumentAnalysisRequestHandlerTest, TestLegacyNumericUtils, DistributedFacetPivotSmallAdvancedTest, TestDefaultStatsCache, ParsingFieldUpdateProcessorsTest, ZkNodePropsTest, TestSimpleTextCodec, AddSchemaFieldsUpdateProcessorFactoryTest, TestDocumentBuilder, XmlUpdateRequestHandlerTest, OverseerStatusTest, TestSizeLimitedDistributedMap, HealthCheckHandlerTest, TestSimDistributedQueue, TestCustomSort, SolrPluginUtilsTest, DistributedVersionInfoTest, TestSlowCompositeReaderWrapper, TestIndexSearcher, TestXmlQParserPlugin, CdcrBidirectionalTest, SolrIndexSplitterTest, TestStreamBody, ShufflingReplicaListTransformerTest, TestSolrQueryParser, TestNRTOpen, TestCustomDocTransformer, BlobRepositoryCloudTest, TestHashPartitioner, ExitableDirectoryReaderTest, SynonymTokenizerTest, TestCSVResponseWriter, ZkFailoverTest, ImplicitSnitchTest, SegmentsInfoRequestHandlerTest, DistribDocExpirationUpdateProcessorTest, EchoParamsTest, TestCloudNestedDocsSort, TestZkAclsWithHadoopAuth, MBeansHandlerTest, TestWordDelimiterFilterFactory, RecoveryAfterSoftCommitTest, TestPKIAuthenticationPlugin, TermVectorComponentDistributedTest, CursorPagingTest, CollectionReloadTest, TestHttpShardHandlerFactory, ShardRoutingTest, TestDelegationWithHadoopAuth, SparseHLLTest, ActionThrottleTest, TestPullReplica, TestSortByMinMaxFunction, TestConfig, TestCSVLoader, ConfigureRecoveryStrategyTest, TestWriterPerf, SpellCheckCollatorTest, DocValuesMissingTest, TestMultiWordSynonyms, NumberUtilsTest, TestSort, TestFieldCacheWithThreads, TestFieldTypeResource, TestCloudDeleteByQuery, TestSortableTextField, TestManagedSchema, ClassificationUpdateProcessorFactoryTest, TestExecutePlanAction, TestSolrConfigHandlerConcurrent, TestQuerySenderNoQuery, TestBinaryField, SharedFSAutoReplicaFailoverTest, ZkCLITest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestExactStatsCache, TestSimpleQParserPlugin, UtilsToolTest, BasicAuthStandaloneTest, TestRandomRequestDistribution, DistributedFacetExistsSmallTest, TestClusterStateProvider, TestFastOutputStream, SolrXmlInZkTest, FieldAnalysisRequestHandlerTest, DeleteShardTest, CdcrReplicationHandlerTest, TestLeaderElectionZkExpiry, TestManagedResourceStorage, TestCrossCoreJoin, TestCollectionAPIs, ComputePlanActionTest, TestCollectionAPI, RequestHandlersTest, ExternalFileFieldSortTest, TestGraphMLResponseWriter, TestLuceneIndexBackCompat, CoreAdminRequestStatusTest, RankQueryTest, SimpleMLTQParserTest, TestReplicationHandlerBackup, CloneFieldUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, AnalysisErrorHandlingTest, DeleteLastCustomShardedReplicaTest, UUIDFieldTest, TestSolrDeletionPolicy1, TestConfigReload, HighlighterConfigTest, SolrJmxReporterCloudTest, ChaosMonkeyNothingIsSafeTest, OpenExchangeRatesOrgProviderTest, TestStressLucene, TestInPlaceUpdatesStandalone, BasicDistributedZkTest, BufferStoreTest, TestDocSet, BinaryUpdateRequestHandlerTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ClusterStateUpdateTest, TestRandomFaceting, TestRandomDVFaceting, TestDistributedSearch, TestRangeQuery, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, DistanceFunctionTest, XsltUpdateRequestHandlerTest, DebugComponentTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestOmitPositions, DocumentBuilderTest, TestIndexingPerformance, RegexBoostProcessorTest, IndexSchemaTest, TestAnalyzedSuggestions, PingRequestHandlerTest, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, TestMergePolicyConfig, SampleTest, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, TestSolrCoreProperties, TestLuceneMatchVersion, TestPhraseSuggestions, TestCharFilters, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, ResourceLoaderTest, ScriptEngineTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, SliceStateTest, SystemInfoHandlerTest, CircularListTest, DistributedMLTComponentTest, SolrTestCaseJ4Test, TestHighlightDedupGrouping, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, DeleteNodeTest, LeaderFailureAfterFreshStartTest, MoveReplicaHDFSTest, TestCloudConsistency]
[junit4] Completed [569/780 (1!)] on J0 in 208.41s, 2 tests, 1 failure <<< FAILURES!
[...truncated 44361 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21572/consoleText
[repro] Revision: 97299ed00699c248fc38465ee1b0eb0bb1561d3d
[repro] Ant options: "-Dargs=-server -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=TestCloudConsistency -Dtests.method=testOutOfSyncReplicasCannotBecomeLeaderAfterRestart -Dtests.seed=7F4947079F714EA4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=US/East-Indiana -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudConsistency
[repro] ant compile-test
[...truncated 3292 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudConsistency" -Dtests.showOutput=onerror "-Dargs=-server -XX:+UseParallelGC" -Dtests.seed=7F4947079F714EA4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=US/East-Indiana -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 76 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.TestCloudConsistency
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-10-ea+43) - Build
# 21573 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21573/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F8C80E019B54EAA1:5205DDF32C873F71]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:303)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
Error Message:
Timeout waiting for active collection null Live Nodes: [127.0.0.1:33725_solr, 127.0.0.1:38885_solr, 127.0.0.1:44303_solr, 127.0.0.1:46499_solr] Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={ "pullReplicas":"0", "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node62":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61", "base_url":"https://127.0.0.1:38885/solr", "node_name":"127.0.0.1:38885_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node64":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63", "base_url":"https://127.0.0.1:33725/solr", "node_name":"127.0.0.1:33725_solr", "state":"down", "type":"NRT"}, "core_node66":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65", "base_url":"https://127.0.0.1:46499/solr", "node_name":"127.0.0.1:46499_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timeout waiting for active collection
null
Live Nodes: [127.0.0.1:33725_solr, 127.0.0.1:38885_solr, 127.0.0.1:44303_solr, 127.0.0.1:46499_solr]
Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={
"pullReplicas":"0",
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node62":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61",
"base_url":"https://127.0.0.1:38885/solr",
"node_name":"127.0.0.1:38885_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node64":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63",
"base_url":"https://127.0.0.1:33725/solr",
"node_name":"127.0.0.1:33725_solr",
"state":"down",
"type":"NRT"},
"core_node66":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65",
"base_url":"https://127.0.0.1:46499/solr",
"node_name":"127.0.0.1:46499_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([F8C80E019B54EAA1:D05D9C5448D93BFA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestCloudConsistency.addDocToWhenOtherReplicasAreDown(TestCloudConsistency.java:164)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:122)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart(TestCloudConsistency.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
Error Message:
Timeout waiting for active collection null Live Nodes: [127.0.0.1:35213_solr, 127.0.0.1:35333_solr, 127.0.0.1:38947_solr, 127.0.0.1:45097_solr] Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={ "pullReplicas":"0", "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node62":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61", "base_url":"https://127.0.0.1:45097/solr", "node_name":"127.0.0.1:45097_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node64":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63", "base_url":"https://127.0.0.1:35333/solr", "node_name":"127.0.0.1:35333_solr", "state":"down", "type":"NRT"}, "core_node66":{ "core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65", "base_url":"https://127.0.0.1:35213/solr", "node_name":"127.0.0.1:35213_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timeout waiting for active collection
null
Live Nodes: [127.0.0.1:35213_solr, 127.0.0.1:35333_solr, 127.0.0.1:38947_solr, 127.0.0.1:45097_solr]
Last available state: DocCollection(outOfSyncReplicasCannotBecomeLeader-true//collections/outOfSyncReplicasCannotBecomeLeader-true/state.json/23)={
"pullReplicas":"0",
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node62":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n61",
"base_url":"https://127.0.0.1:45097/solr",
"node_name":"127.0.0.1:45097_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node64":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n63",
"base_url":"https://127.0.0.1:35333/solr",
"node_name":"127.0.0.1:35333_solr",
"state":"down",
"type":"NRT"},
"core_node66":{
"core":"outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65",
"base_url":"https://127.0.0.1:35213/solr",
"node_name":"127.0.0.1:35213_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([F8C80E019B54EAA1:D05D9C5448D93BFA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestCloudConsistency.addDocToWhenOtherReplicasAreDown(TestCloudConsistency.java:164)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:122)
at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart(TestCloudConsistency.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13295 lines...]
[junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/init-core-data-001
[junit4] 2> 787110 WARN (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 787110 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 787110 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 787110 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 787111 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001
[junit4] 2> 787111 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 787111 INFO (Thread-2066) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 787111 INFO (Thread-2066) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 787112 ERROR (Thread-2066) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 787211 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38339
[junit4] 2> 787213 INFO (zkConnectionManagerCallback-1514-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787216 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100154282810000, likely client has closed socket
[junit4] 2> 787217 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 787217 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 787217 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 787217 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 787221 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70028c4b{/solr,null,AVAILABLE}
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72274595{/solr,null,AVAILABLE}
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@364ca896{/solr,null,AVAILABLE}
[junit4] 2> 787222 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3606b55e{/solr,null,AVAILABLE}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7cccc1d1{SSL,[ssl, http/1.1]}{127.0.0.1:٣٦٤٨٩}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@38a41a62{SSL,[ssl, http/1.1]}{127.0.0.1:٣٩٧٣٩}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4b4b198f{SSL,[ssl, http/1.1]}{127.0.0.1:٣٦٦٩٩}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.e.j.s.Server Started @٧٨٨٥٨٨ms
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.e.j.s.Server Started @٧٨٨٥٨٨ms
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39739}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36699}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.e.j.s.Server Started @٧٨٨٥٨٨ms
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@56ec449a{SSL,[ssl, http/1.1]}{127.0.0.1:٤١٥٨٩}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36489}
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.e.j.s.Server Started @٧٨٨٥٨٨ms
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41589}
[junit4] 2> 787223 ERROR (jetty-launcher-1511-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 787223 ERROR (jetty-launcher-1511-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:33.338658Z
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:33.338673Z
[junit4] 2> 787223 ERROR (jetty-launcher-1511-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 787223 ERROR (jetty-launcher-1511-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:33.338862Z
[junit4] 2> 787223 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:33.338885Z
[junit4] 2> 787224 INFO (zkConnectionManagerCallback-1517-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787224 INFO (zkConnectionManagerCallback-1518-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787224 INFO (zkConnectionManagerCallback-1522-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787224 INFO (zkConnectionManagerCallback-1520-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787224 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 787224 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 787224 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 787224 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 787227 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100154282810002, likely client has closed socket
[junit4] 2> 787228 INFO (jetty-launcher-1511-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 787228 INFO (jetty-launcher-1511-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 787228 INFO (jetty-launcher-1511-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 787228 INFO (jetty-launcher-1511-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 787229 INFO (zkConnectionManagerCallback-1534-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787229 INFO (zkConnectionManagerCallback-1531-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787229 INFO (zkConnectionManagerCallback-1538-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787229 INFO (zkConnectionManagerCallback-1536-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787230 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100154282810007, likely client has closed socket
[junit4] 2> 787230 INFO (zkConnectionManagerCallback-1540-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787230 INFO (zkConnectionManagerCallback-1544-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787230 INFO (zkConnectionManagerCallback-1546-thread-1-processing-n:127.0.0.1:41589_solr) [n:127.0.0.1:41589_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787231 INFO (zkConnectionManagerCallback-1545-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787263 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 787263 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 787263 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 787263 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 787264 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36699_solr
[junit4] 2> 787264 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36489_solr
[junit4] 2> 787264 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39739_solr
[junit4] 2> 787264 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41589_solr
[junit4] 2> 787264 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.c.Overseer Overseer (id=72080969439445002-127.0.0.1:36699_solr-n_0000000000) starting
[junit4] 2> 787265 INFO (zkCallback-1543-thread-1-processing-n:127.0.0.1:41589_solr) [n:127.0.0.1:41589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 787267 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 787268 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 787268 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 787275 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36699_solr
[junit4] 2> 787275 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 787275 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 787275 INFO (zkCallback-1543-thread-1-processing-n:127.0.0.1:41589_solr) [n:127.0.0.1:41589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 787275 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 787299 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41589.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787303 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36489.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787304 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41589.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787304 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41589.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787305 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39739.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787305 INFO (jetty-launcher-1511-thread-3) [n:127.0.0.1:41589_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node3/.
[junit4] 2> 787308 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36489.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787308 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36489.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787309 INFO (jetty-launcher-1511-thread-1) [n:127.0.0.1:36489_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node1/.
[junit4] 2> 787313 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39739.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787313 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39739.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787314 INFO (jetty-launcher-1511-thread-4) [n:127.0.0.1:39739_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node4/.
[junit4] 2> 787316 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36699.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787321 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36699.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787322 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36699.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 787322 INFO (jetty-launcher-1511-thread-2) [n:127.0.0.1:36699_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node2/.
[junit4] 2> 787408 INFO (zkConnectionManagerCallback-1556-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787410 INFO (zkConnectionManagerCallback-1560-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 787411 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 787411 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38339/solr ready
[junit4] 2> 787415 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@56ec449a{SSL,[ssl, http/1.1]}{127.0.0.1:٠}
[junit4] 2> 787415 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1831763643
[junit4] 2> 787415 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 787415 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b4b1a5c: rootName = solr_41589, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@484dbe14
[junit4] 2> 787419 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 787419 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7b98d261: rootName = solr_41589, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@19e710ff
[junit4] 2> 787422 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 787422 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a0bf33f: rootName = solr_41589, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@780d31e8
[junit4] 2> 787423 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41589_solr
[junit4] 2> 787423 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 787423 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 787423 INFO (zkCallback-1543-thread-1-processing-n:127.0.0.1:41589_solr) [n:127.0.0.1:41589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 787424 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 787423 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 787424 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 787424 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 788924 WARN (zkCallback-1543-thread-1-processing-n:127.0.0.1:41589_solr) [n:127.0.0.1:41589_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:41589_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:41589_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 788926 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@364ca896{/solr,null,UNAVAILABLE}
[junit4] 2> 788926 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 788928 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 788928 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 788928 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 788928 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 788929 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fd0421b{/solr,null,AVAILABLE}
[junit4] 2> 788929 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5ecf92b2{SSL,[ssl, http/1.1]}{127.0.0.1:٣٥٦٩٥}
[junit4] 2> 788929 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server Started @٧٩٠٢٩٤ms
[junit4] 2> 788929 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45097}
[junit4] 2> 788930 ERROR (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 788930 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 788930 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 788930 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 788930 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:35.045585Z
[junit4] 2> 788931 INFO (zkConnectionManagerCallback-1562-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 788932 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 788935 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 788936 INFO (zkConnectionManagerCallback-1566-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 788938 INFO (zkConnectionManagerCallback-1568-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 788940 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 788941 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 788941 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45097_solr
[junit4] 2> 788942 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 788942 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 788942 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 788942 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 788947 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 788974 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45097.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 788979 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45097.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 788979 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45097.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 788980 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:45097_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node3/.
[junit4] 2> 789006 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:35695/solr. Proxy: https://127.0.0.1:45097/solr
[junit4] 2> 789007 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@38a41a62{SSL,[ssl, http/1.1]}{127.0.0.1:٠}
[junit4] 2> 789007 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2094734147
[junit4] 2> 789007 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 789007 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@201d42c7: rootName = solr_39739, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2e2e615b
[junit4] 2> 789011 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 789012 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1161a3ae: rootName = solr_39739, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@19e710ff
[junit4] 2> 789014 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 789014 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30c21c56: rootName = solr_39739, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@780d31e8
[junit4] 2> 789015 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39739_solr
[junit4] 2> 789016 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 789016 INFO (zkCallback-1539-thread-1-processing-n:127.0.0.1:39739_solr) [n:127.0.0.1:39739_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789016 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789016 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789016 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789016 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789016 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 789017 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@70028c4b{/solr,null,UNAVAILABLE}
[junit4] 2> 789017 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 789018 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 789018 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 789018 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 789018 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 789018 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1870662c{/solr,null,AVAILABLE}
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@72157f31{SSL,[ssl, http/1.1]}{127.0.0.1:٣٤٣١٣}
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server Started @٧٩٠٣٨٤ms
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35333}
[junit4] 2> 789019 ERROR (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 789019 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:35.134893Z
[junit4] 2> 789020 INFO (zkConnectionManagerCallback-1572-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789021 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 789024 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 789025 INFO (zkConnectionManagerCallback-1576-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789027 INFO (zkConnectionManagerCallback-1578-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789030 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 789031 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 789032 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35333_solr
[junit4] 2> 789032 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789032 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789032 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789032 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789032 INFO (zkCallback-1577-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789054 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35333.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789060 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35333.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789060 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35333.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789061 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35333_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node4/.
[junit4] 2> 789086 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:34313/solr. Proxy: https://127.0.0.1:35333/solr
[junit4] 2> 789087 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4b4b198f{SSL,[ssl, http/1.1]}{127.0.0.1:٠}
[junit4] 2> 789088 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1966856334
[junit4] 2> 789088 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 789088 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@619860ae: rootName = solr_36699, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@171098f5
[junit4] 2> 789092 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 789092 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6975b81e: rootName = solr_36699, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@19e710ff
[junit4] 2> 789095 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 789095 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5c43bd0d: rootName = solr_36699, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@780d31e8
[junit4] 2> 789096 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36699_solr
[junit4] 2> 789096 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 789096 INFO (zkCallback-1577-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789097 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789097 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 789097 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789097 INFO (zkCallback-1541-thread-1-processing-n:127.0.0.1:36699_solr) [n:127.0.0.1:36699_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789097 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789097 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.Overseer Overseer (id=72080969439445002-127.0.0.1:36699_solr-n_0000000000) closing
[junit4] 2> 789097 INFO (OverseerStateUpdate-72080969439445002-127.0.0.1:36699_solr-n_0000000000) [n:127.0.0.1:36699_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36699_solr
[junit4] 2> 789097 WARN (OverseerAutoScalingTriggerThread-72080969439445002-127.0.0.1:36699_solr-n_0000000000) [n:127.0.0.1:36699_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 789099 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36489_solr
[junit4] 2> 789099 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3606b55e{/solr,null,UNAVAILABLE}
[junit4] 2> 789100 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 789100 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.Overseer Overseer (id=72080969439445004-127.0.0.1:36489_solr-n_0000000001) starting
[junit4] 2> 789101 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 789102 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 789102 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 789102 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 789103 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@433592b1{/solr,null,AVAILABLE}
[junit4] 2> 789103 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5dc3be97{SSL,[ssl, http/1.1]}{127.0.0.1:٣٦٥٥٣}
[junit4] 2> 789103 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server Started @٧٩٠٤٦٨ms
[junit4] 2> 789104 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35213}
[junit4] 2> 789104 ERROR (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 789104 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 789104 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 789104 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 789104 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:35.219692Z
[junit4] 2> 789106 INFO (zkConnectionManagerCallback-1582-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789106 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 789109 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 789110 INFO (zkConnectionManagerCallback-1586-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789111 INFO (zkConnectionManagerCallback-1588-thread-1-processing-n:127.0.0.1:35213_solr) [n:127.0.0.1:35213_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789114 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 789114 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 789115 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35213_solr
[junit4] 2> 789115 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789115 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789116 INFO (zkCallback-1587-thread-1-processing-n:127.0.0.1:35213_solr) [n:127.0.0.1:35213_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789115 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789115 INFO (zkCallback-1577-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789157 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35213.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789162 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35213.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789162 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35213.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789163 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:35213_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node2/.
[junit4] 2> 789188 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:36553/solr. Proxy: https://127.0.0.1:35213/solr
[junit4] 2> 789189 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7cccc1d1{SSL,[ssl, http/1.1]}{127.0.0.1:٠}
[junit4] 2> 789190 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=45860349
[junit4] 2> 789190 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 789190 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2bc6dd2e: rootName = solr_36489, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@14a087cb
[junit4] 2> 789194 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 789194 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2dec8775: rootName = solr_36489, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@19e710ff
[junit4] 2> 789196 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 789197 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66209682: rootName = solr_36489, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@780d31e8
[junit4] 2> 789197 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36489_solr
[junit4] 2> 789198 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 789198 INFO (zkCallback-1542-thread-1-processing-n:127.0.0.1:36489_solr) [n:127.0.0.1:36489_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789198 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789198 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 789198 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789198 INFO (zkCallback-1577-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789198 INFO (zkCallback-1587-thread-1-processing-n:127.0.0.1:35213_solr) [n:127.0.0.1:35213_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 789199 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.Overseer Overseer (id=72080969439445004-127.0.0.1:36489_solr-n_0000000001) closing
[junit4] 2> 789199 INFO (OverseerStateUpdate-72080969439445004-127.0.0.1:36489_solr-n_0000000001) [n:127.0.0.1:36489_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36489_solr
[junit4] 2> 789199 WARN (OverseerAutoScalingTriggerThread-72080969439445004-127.0.0.1:36489_solr-n_0000000001) [n:127.0.0.1:36489_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 789200 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@72274595{/solr,null,UNAVAILABLE}
[junit4] 2> 789200 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45097_solr
[junit4] 2> 789200 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 789200 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.Overseer Overseer (id=72080969439445009-127.0.0.1:45097_solr-n_0000000004) starting
[junit4] 2> 789201 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 789201 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 789201 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 789201 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 789201 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fe0cafc{/solr,null,AVAILABLE}
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a3b0e6e{SSL,[ssl, http/1.1]}{127.0.0.1:٤٢٩٧٣}
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.e.j.s.Server Started @٧٩٠٥٦٧ms
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38947}
[junit4] 2> 789202 ERROR (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 789202 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-05T03:04:35.317738Z
[junit4] 2> 789203 INFO (zkConnectionManagerCallback-1592-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789203 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 789206 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38339/solr
[junit4] 2> 789207 INFO (zkConnectionManagerCallback-1596-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789208 INFO (zkConnectionManagerCallback-1598-thread-1-processing-n:127.0.0.1:38947_solr) [n:127.0.0.1:38947_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 789211 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 789211 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 789212 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38947_solr
[junit4] 2> 789212 INFO (zkCallback-1567-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789212 INFO (zkCallback-1577-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789212 INFO (zkCallback-1559-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789212 INFO (zkCallback-1587-thread-1-processing-n:127.0.0.1:35213_solr) [n:127.0.0.1:35213_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789213 INFO (zkCallback-1597-thread-1-processing-n:127.0.0.1:38947_solr) [n:127.0.0.1:38947_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 789241 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38947.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789246 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38947.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789246 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38947.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@146aba
[junit4] 2> 789247 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [n:127.0.0.1:38947_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001/tempDir-001/node1/.
[junit4] 2> 789272 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:42973/solr. Proxy: https://127.0.0.1:38947/solr
[junit4] 2> 789280 INFO (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[F8C80E019B54EAA1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOutOfSyncReplicasCannotBecomeLeader
[junit4] 2> 789281 INFO (SocketProxy-Acceptor-35213) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60182,localport=35213], receiveBufferSize:531000
[junit4] 2> 789283 INFO (SocketProxy-Acceptor-35213) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36553,localport=45170], receiveBufferSize=530904
[junit4] 2> 789332 INFO (qtp1618837506-8442) [n:127.0.0.1:35213_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=3&name=outOfSyncReplicasCannotBecomeLeader-false&nrtReplicas=3&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 789333 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection outOfSyncReplicasCannotBecomeLeader-false
[junit4] 2> 789334 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/protwords.txt
[junit4] 2> 789334 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/managed-schema
[junit4] 2> 789335 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/solrconfig.xml
[junit4] 2> 789336 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/synonyms.txt
[junit4] 2> 789336 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/stopwords.txt
[junit4] 2> 789337 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_it.txt
[junit4] 2> 789337 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stemdict_nl.txt
[junit4] 2> 789338 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hy.txt
[junit4] 2> 789338 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_no.txt
[junit4] 2> 789339 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/contractions_ca.txt
[junit4] 2> 789339 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_id.txt
[junit4] 2> 789339 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ga.txt
[junit4] 2> 789340 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hi.txt
[junit4] 2> 789340 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_da.txt
[junit4] 2> 789341 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ja.txt
[junit4] 2> 789341 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_pt.txt
[junit4] 2> 789342 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_hu.txt
[junit4] 2> 789342 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_el.txt
[junit4] 2> 789343 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/lang/stopwords_ru.txt
[junit4] 2> 789343 INFO (OverseerThreadFactory-2686-thread-1-processing-n:127.0.0.1:45097_solr) [n:127.0.0.1:45097_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_t
[...truncated too long message...]
2>
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.RecoveryStrategy Replay not started, or was not successful... still buffering updates.
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false]
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.SolrCore [outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] CLOSING SolrCore org.apache.solr.core.SolrCore@67eccb2f
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.outOfSyncReplicasCannotBecomeLeader-true.shard1.replica_n65, tag=1743571759
[junit4] 2> 392522 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@499f0fda: rootName = solr_46499, domain = solr.core.outOfSyncReplicasCannotBecomeLeader-true.shard1.replica_n65, service url = null, agent id = null] for registry solr.core.outOfSyncReplicasCannotBecomeLeader-true.shard1.replica_n65 / com.codahale.metrics.MetricRegistry@65372804
[junit4] 2> 392530 INFO (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.outOfSyncReplicasCannotBecomeLeader-true.shard1.leader, tag=1743571759
[junit4] 2> 392530 WARN (recoveryExecutor-343-thread-1-processing-n:127.0.0.1:46499_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65 s:shard1 c:outOfSyncReplicasCannotBecomeLeader-true r:core_node66) [n:127.0.0.1:46499_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] o.a.s.c.RecoveryStrategy Stopping recovery for core=[outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n65] coreNodeName=[core_node66]
[junit4] 2> 392535 INFO (jetty-closer-227-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@28cda70d{/solr,null,UNAVAILABLE}
[junit4] 2> 392535 INFO (jetty-closer-227-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 392535 ERROR (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 392535 INFO (SUITE-TestCloudConsistency-seed#[F8C80E019B54EAA1]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36231 36231
[junit4] 2> 392541 INFO (Thread-2046) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36231 36231
[junit4] 2> 392548 WARN (Thread-2046) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 33 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/terms/shard1
[junit4] 2> 27 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/terms/shard1
[junit4] 2> 13 /solr/aliases.json
[junit4] 2> 12 /solr/security.json
[junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED
[junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-schema
[junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/managed-schema
[junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 59 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/state.json
[junit4] 2> 56 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/state.json
[junit4] 2> 13 /solr/clusterprops.json
[junit4] 2> 13 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/72081114786955270-127.0.0.1:39865_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72081114786955275-127.0.0.1:44975_solr-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72081114786955290-127.0.0.1:44303_solr-n_0000000007
[junit4] 2> 2 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/leader_elect/shard1/election/72081114786955293-core_node62-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 13 /solr/collections
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudConsistency_F8C80E019B54EAA1-001
[junit4] 2> Mar 05, 2018 3:44:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@62c958b3), locale=ckb-IQ, timezone=Africa/Windhoek
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=298442320,total=529530880
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudConsistency, MoveReplicaHDFSTest, TestCloudConsistency]
[junit4] Completed [10/10 (1!)] on J0 in 207.03s, 2 tests, 1 failure <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1085: There were test failures: 10 suites, 30 tests, 1 failure [seed: F8C80E019B54EAA1]
Total time: 6 minutes 36 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.MoveReplicaHDFSTest
[repro] 1/5 failed: org.apache.solr.cloud.TestCloudConsistency
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=dc5db9b2f1050f1d1fc545c33f117ae4ec867983, workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #21572
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2