You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/03 00:03:08 UTC
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build #
1458 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1458/
Java: 64bit/jdk-10-ea+43 -XX:+UseCompressedOops -XX:+UseSerialGC
3 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([92571A44F51E1978:14C5236ABE3424C]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([92571A44F51E1978:5BE258EAFC79DF8D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([92571A44F51E1978:5BE258EAFC79DF8D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13476 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/init-core-data-001
[junit4] 2> 1088165 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1088166 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1088166 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1088166 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001
[junit4] 2> 1088166 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1088166 INFO (Thread-10399) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1088166 INFO (Thread-10399) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1088168 ERROR (Thread-10399) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1088266 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36323
[junit4] 2> 1088267 INFO (zkConnectionManagerCallback-2268-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088269 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1088269 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48a2480c{/solr,null,AVAILABLE}
[junit4] 2> 1088270 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d994ad1{/solr,null,AVAILABLE}
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@664a4d18{HTTP/1.1,[http/1.1]}{127.0.0.1:42653}
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1ddae0a{HTTP/1.1,[http/1.1]}{127.0.0.1:33403}
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-2) [ ] o.e.j.s.Server Started @1089966ms
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-1) [ ] o.e.j.s.Server Started @1089966ms
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42653}
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33403}
[junit4] 2> 1088271 ERROR (jetty-launcher-2265-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1088271 ERROR (jetty-launcher-2265-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1088271 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T23:17:23.599118Z
[junit4] 2> 1088272 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T23:17:23.599155Z
[junit4] 2> 1088273 INFO (zkConnectionManagerCallback-2271-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088273 INFO (zkConnectionManagerCallback-2272-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088273 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1088273 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1088276 INFO (jetty-launcher-2265-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36323/solr
[junit4] 2> 1088277 INFO (jetty-launcher-2265-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36323/solr
[junit4] 2> 1088277 INFO (zkConnectionManagerCallback-2277-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088278 INFO (zkConnectionManagerCallback-2280-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088279 INFO (zkConnectionManagerCallback-2282-thread-1-processing-n:127.0.0.1:42653_solr) [n:127.0.0.1:42653_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088279 INFO (zkConnectionManagerCallback-2284-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088318 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1088318 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1088319 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42653_solr
[junit4] 2> 1088319 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33403_solr
[junit4] 2> 1088319 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.c.Overseer Overseer (id=72068751580528645-127.0.0.1:42653_solr-n_0000000000) starting
[junit4] 2> 1088320 INFO (zkCallback-2281-thread-1-processing-n:127.0.0.1:42653_solr) [n:127.0.0.1:42653_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1088320 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1088323 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1088323 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1088323 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42653_solr
[junit4] 2> 1088323 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33403_solr]
[junit4] 2> 1088323 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1088323 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1088324 INFO (zkCallback-2281-thread-1-processing-n:127.0.0.1:42653_solr) [n:127.0.0.1:42653_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1088324 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1088324 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1088324 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1088324 DEBUG (ScheduledTrigger-4292-thread-1) [n:127.0.0.1:42653_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1088363 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33403.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088368 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33403.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088368 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33403.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088369 INFO (jetty-launcher-2265-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001/node1/.
[junit4] 2> 1088377 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42653.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088386 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42653.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088386 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42653.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1088386 INFO (jetty-launcher-2265-thread-2) [n:127.0.0.1:42653_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001/node2/.
[junit4] 2> 1088410 INFO (zkConnectionManagerCallback-2290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088412 INFO (zkConnectionManagerCallback-2294-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1088412 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1088413 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36323/solr ready
[junit4] 2> 1088419 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSetProperties
[junit4] 2> 1088420 INFO (qtp1920575703-19616) [n:127.0.0.1:33403_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1088423 INFO (qtp1920575703-19616) [n:127.0.0.1:33403_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1088424 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 1088425 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 1088425 DEBUG (zkCallback-2281-thread-1-processing-n:127.0.0.1:42653_solr) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1088425 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1088425 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1088425 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1088425 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1088425 DEBUG (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1088426 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@664a4d18{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1088426 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1457946447
[junit4] 2> 1088426 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1088426 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6d9cd276: rootName = solr_42653, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@17369c13
[junit4] 2> 1088430 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1088431 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@40d335b: rootName = solr_42653, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2ec6884
[junit4] 2> 1088434 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1088434 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@498a0ee9: rootName = solr_42653, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61eec121
[junit4] 2> 1088435 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42653_solr
[junit4] 2> 1088435 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1088435 INFO (zkCallback-2281-thread-1-processing-n:127.0.0.1:42653_solr) [n:127.0.0.1:42653_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1088435 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1088435 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1088436 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.Overseer Overseer (id=72068751580528645-127.0.0.1:42653_solr-n_0000000000) closing
[junit4] 2> 1088436 INFO (OverseerStateUpdate-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42653_solr
[junit4] 2> 1088436 WARN (OverseerAutoScalingTriggerThread-72068751580528645-127.0.0.1:42653_solr-n_0000000000) [n:127.0.0.1:42653_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1088440 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1088440 INFO (zkCallback-2293-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1088440 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1088442 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33403_solr
[junit4] 2> 1088443 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3d994ad1{/solr,null,UNAVAILABLE}
[junit4] 2> 1088443 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1088443 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.Overseer Overseer (id=72068751580528646-127.0.0.1:33403_solr-n_0000000001) starting
[junit4] 2> 1088445 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1088446 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1088446 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33403_solr]
[junit4] 2> 1088446 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
[junit4] 2> 1088446 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1088450 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1088451 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1088451 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1089451 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1090452 DEBUG (ScheduledTrigger-4301-thread-2) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1091452 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1092452 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1093444 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1093444 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1093444 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1093445 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1093445 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18a667ae{/solr,null,AVAILABLE}
[junit4] 2> 1093445 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f39f879{HTTP/1.1,[http/1.1]}{127.0.0.1:40117}
[junit4] 2> 1093445 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server Started @1095140ms
[junit4] 2> 1093445 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40117}
[junit4] 2> 1093445 ERROR (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1093446 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1093446 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1093446 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1093446 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T23:17:28.773199Z
[junit4] 2> 1093447 INFO (zkConnectionManagerCallback-2297-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1093447 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1093451 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36323/solr
[junit4] 2> 1093451 INFO (zkConnectionManagerCallback-2301-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1093452 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1093453 INFO (zkConnectionManagerCallback-2303-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1093456 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1093457 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1093457 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40117_solr
[junit4] 2> 1093458 INFO (zkCallback-2293-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1093458 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1093458 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1093458 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1093484 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40117.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1093491 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40117.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1093491 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40117.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1093492 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [n:127.0.0.1:40117_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001/node3/.
[junit4] 2> 1094452 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1094511 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 1 to: 4
[junit4] 2> 1095453 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1096453 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1097453 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1098453 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1099454 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1100454 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1101454 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1102454 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1102513 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 4 to: 1
[junit4] 2> 1103454 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1104455 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1105455 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1106455 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1107455 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1108455 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1109456 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1110456 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1111456 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1112456 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1112516 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerCorePoolSize from: 4 to: 6
[junit4] 2> 1113456 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1114457 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1115457 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1116457 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1117457 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1118457 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1119458 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1120458 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1121458 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1122458 DEBUG (ScheduledTrigger-4301-thread-1) [n:127.0.0.1:33403_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 1122519 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[92571A44F51E1978]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSetProperties
[junit4] 2> 1122526 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
[junit4] 2> 1122528 INFO (qtp1920575703-19624) [n:127.0.0.1:33403_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1122531 INFO (qtp1920575703-19624) [n:127.0.0.1:33403_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1122531 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 1122532 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 4
[junit4] 2> 1122532 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1122533 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1ddae0a{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1122533 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1614226649
[junit4] 2> 1122533 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1122533 DEBUG (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1122533 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4afbcff2: rootName = solr_33403, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@420f2f5b
[junit4] 2> 1122533 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1122533 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1122534 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1122534 DEBUG (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1122538 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1122538 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@669e268f: rootName = solr_33403, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2ec6884
[junit4] 2> 1122543 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1122543 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@16f57915: rootName = solr_33403, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@61eec121
[junit4] 2> 1122544 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33403_solr
[junit4] 2> 1122545 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1122545 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1122545 INFO (zkCallback-2283-thread-1-processing-n:127.0.0.1:33403_solr) [n:127.0.0.1:33403_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1122545 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1122545 INFO (zkCallback-2293-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1122545 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.Overseer Overseer (id=72068751580528646-127.0.0.1:33403_solr-n_0000000001) closing
[junit4] 2> 1122545 INFO (OverseerStateUpdate-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33403_solr
[junit4] 2> 1122545 WARN (OverseerAutoScalingTriggerThread-72068751580528646-127.0.0.1:33403_solr-n_0000000001) [n:127.0.0.1:33403_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1122547 INFO (zkCallback-2293-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1122554 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1122554 DEBUG (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1122555 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40117_solr
[junit4] 2> 1122555 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.Overseer Overseer (id=72068751580528651-127.0.0.1:40117_solr-n_0000000002) starting
[junit4] 2> 1122558 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48a2480c{/solr,null,UNAVAILABLE}
[junit4] 2> 1122562 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1122564 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1122564 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 1122565 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40117_solr]
[junit4] 2> 1122565 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion -1
[junit4] 2> 1122565 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 1122566 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1122566 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 1122566 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1123567 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1124567 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1125567 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1126568 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1127564 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1127564 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1127564 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@185f9c44{/solr,null,AVAILABLE}
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24a40f77{HTTP/1.1,[http/1.1]}{127.0.0.1:44121}
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server Started @1129260ms
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44121}
[junit4] 2> 1127565 ERROR (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1127565 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T23:18:02.892967Z
[junit4] 2> 1127566 INFO (zkConnectionManagerCallback-2308-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127567 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1127568 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 1127575 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36323/solr
[junit4] 2> 1127577 INFO (zkConnectionManagerCallback-2312-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127579 INFO (zkConnectionManagerCallback-2314-thread-1-processing-n:127.0.0.1:44121_solr) [n:127.0.0.1:44121_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127581 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1127582 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1127583 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44121_solr
[junit4] 2> 1127583 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1127583 INFO (zkCallback-2293-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1127583 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1127584 INFO (zkCallback-2313-thread-1-processing-n:127.0.0.1:44121_solr) [n:127.0.0.1:44121_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1127584 INFO (zkCallback-2293-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1127617 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44121.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127624 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44121.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127624 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44121.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127625 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:44121_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001/node4/.
[junit4] 2> 1127645 INFO (qtp2144730322-19754) [n:127.0.0.1:40117_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1127646 INFO (qtp1139538258-19729) [n:127.0.0.1:44121_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1127647 DEBUG (qtp2144730322-19688) [n:127.0.0.1:40117_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1127647 INFO (qtp2144730322-19688) [n:127.0.0.1:40117_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1127647 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 1127648 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1127648 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1127648 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 1127648 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 1127649 INFO (qtp2144730322-19753) [n:127.0.0.1:40117_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1127649 INFO (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 1127649 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 1127650 DEBUG (ScheduledTrigger-4314-thread-3) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 1127650 DEBUG (ScheduledTrigger-4314-thread-3) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 1127650 INFO (qtp1139538258-19759) [n:127.0.0.1:44121_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1127650 DEBUG (qtp1139538258-19735) [n:127.0.0.1:44121_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1127651 INFO (qtp1139538258-19735) [n:127.0.0.1:44121_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1127651 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 1127651 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 1127652 INFO (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 1127652 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 1127652 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 1127652 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 1127653 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1127653 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1127653 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1127653 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1127653 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e30f1c4{/solr,null,AVAILABLE}
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@356abf72{HTTP/1.1,[http/1.1]}{127.0.0.1:39671}
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.e.j.s.Server Started @1129349ms
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39671}
[junit4] 2> 1127654 ERROR (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1127654 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-02T23:18:02.981816Z
[junit4] 2> 1127655 INFO (zkConnectionManagerCallback-2318-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127656 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1127660 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36323/solr
[junit4] 2> 1127661 INFO (zkConnectionManagerCallback-2322-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127662 INFO (zkConnectionManagerCallback-2324-thread-1-processing-n:127.0.0.1:39671_solr) [n:127.0.0.1:39671_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1127665 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1127666 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1127667 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39671_solr
[junit4] 2> 1127667 INFO (zkCallback-2293-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127667 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127667 INFO (zkCallback-2293-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127667 INFO (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127668 INFO (zkCallback-2323-thread-1-processing-n:127.0.0.1:39671_solr) [n:127.0.0.1:39671_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127667 INFO (zkCallback-2313-thread-1-processing-n:127.0.0.1:44121_solr) [n:127.0.0.1:44121_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1127727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39671.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127735 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39671.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127735 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39671.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1518fd24
[junit4] 2> 1127736 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[92571A44F51E1978]) [n:127.0.0.1:39671_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001/tempDir-001/node5/.
[junit4] 2> 1128568 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:39671_solr at time 170291072619045
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:39671_solr] added at times [170291072619045], now=170291072704656
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"9ae0fae45225Tefby0w6tx35ddye83yyrkhy65",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":170291072619045,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[170291072619045],
[junit4] 2> "nodeNames":["127.0.0.1:39671_solr"]}}
[junit4] 2> 1128651 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger2, node_added_trigger1]
[junit4] 2> 1128653 INFO (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 1128654 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"9ae0fae45225Tefby0w6tx35ddye83yyrkhy65",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":170291072619045,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[170291072619045],
[junit4] 2> "_enqueue_time_":170291073601764,
[junit4] 2> "nodeNames":["127.0.0.1:39671_solr"]}}
[junit4] 2> 1128655 INFO (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger1
[junit4] 2> 1128656 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 1128656 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 1128656 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 1128656 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 2 ms for event id=9ae0fae45225Tefby0w6tx35ddye83yyrkhy65
[junit4] 2> 1133656 DEBUG (ScheduledTrigger-4314-thread-1) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-3) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-3) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:39671_solr at time 170296078917275
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:39671_solr] added at times [170296078917275], now=170296078960410
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"9ae2254a5e9bTefby0w6tx35ddye83yyrkhy67",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":170296078917275,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[170296078917275],
[junit4] 2> "nodeNames":["127.0.0.1:39671_solr"]}}
[junit4] 2> 1133657 DEBUG (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger2, node_added_trigger1]
[junit4] 2> 1133658 INFO (ScheduledTrigger-4314-thread-2) [n:127.0.0.1:40117_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 1133658 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"9ae2254a5e9bTefby0w6tx35ddye83yyrkhy67",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":170296078917275,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[170296078917275],
[junit4] 2> "_enqueue_time_":170296079097178,
[junit4] 2> "nodeNames":["127.0.0.1:39671_solr"]}}
[junit4] 2> 1133658 INFO (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest last action at 1520032683982000000 current time = 1520032688985000000
[junit4] 2> real diff: 5003000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 1133658 INFO (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger2
[junit4] 2> 1133659 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 1133659 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
[junit4] 2> 1133659 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
[junit4] 2> 1133659 DEBUG (AutoscalingActionExecutor-4315-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=9ae2254a5e9bTefby0w6tx35ddye83yyrkhy67
[junit4] 2> 1133660 INFO (qtp1991020054-19789) [n:127.0.0.1:39671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133661 INFO (qtp2144730322-19753) [n:127.0.0.1:40117_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133661 INFO (qtp1139538258-19735) [n:127.0.0.1:44121_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133661 DEBUG (qtp1991020054-19763) [n:127.0.0.1:39671_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1133662 INFO (qtp1991020054-19763) [n:127.0.0.1:39671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1133662 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 1133662 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:39671_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1133662 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 1133662 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:39671_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1133662 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:39671_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1133663 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 1133663 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:39671_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1133663 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 1133663 INFO (qtp1991020054-19769) [n:127.0.0.1:39671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133664 INFO (qtp2144730322-19755) [n:127.0.0.1:40117_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133664 INFO (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 1133664 DEBUG (OverseerAutoScalingTriggerThread-72068751580528651-127.0.0.1:40117_solr-n_0000000002) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 1133664 DEBUG (ScheduledTrigger-4314-thread-4) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: 3
[junit4] 2> 1133664 INFO (qtp1139538258-19758) [n:127.0.0.1:44121_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1133664 DEBUG (qtp1991020054-19767) [n:127.0.0.1:39671_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1133665 INFO (qtp1991020054-19767) [n:127.0.0.1:39671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1133665 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 1133665 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0.1:40117_solr) [n:127.0.0.1:40117_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:44121_solr, 127.0.0.1:39671_solr, 127.0.0.1:40117_solr]
[junit4] 2> 1133665 DEBUG (zkCallback-2302-thread-1-processing-n:127.0.0
[...truncated too long message...]
essing-n:127.0.0.1:37863_solr) [n:127.0.0.1:37863_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testScheduledTrigger/state.json] for collection [testScheduledTrigger] has occurred - updating... (live nodes size: [0])
[junit4] 2> 609397 INFO (zkCallback-577-thread-3-processing-n:127.0.0.1:43745_solr) [n:127.0.0.1:43745_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testScheduledTrigger/state.json] for collection [testScheduledTrigger] has occurred - updating... (live nodes size: [0])
[junit4] 2> 609399 INFO (zkCallback-588-thread-3-processing-n:127.0.0.1:41857_solr) [n:127.0.0.1:41857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testScheduledTrigger/state.json] for collection [testScheduledTrigger] has occurred - updating... (live nodes size: [0])
[junit4] 2> 609399 INFO (zkCallback-577-thread-4-processing-n:127.0.0.1:43745_solr) [n:127.0.0.1:43745_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testScheduledTrigger/state.json] for collection [testScheduledTrigger] has occurred - updating... (live nodes size: [0])
[junit4] 2> 609414 INFO (coreCloseExecutor-691-thread-1) [n:127.0.0.1:43745_solr c:testScheduledTrigger s:shard1 r:core_node6 x:testScheduledTrigger_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testScheduledTrigger.shard1.leader, tag=652352416
[junit4] 2> 609414 INFO (coreCloseExecutor-693-thread-1) [n:127.0.0.1:41857_solr c:testScheduledTrigger s:shard1 r:core_node8 x:testScheduledTrigger_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testScheduledTrigger.shard1.leader, tag=1927996227
[junit4] 2> 609414 INFO (coreCloseExecutor-692-thread-1) [n:127.0.0.1:37863_solr c:testScheduledTrigger s:shard1 r:core_node5 x:testScheduledTrigger_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testScheduledTrigger.shard1.leader, tag=556165137
[junit4] 2> 609418 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1000a4a697e0052, likely client has closed socket
[junit4] 2> 609418 INFO (jetty-closer-299-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72068908751650891-127.0.0.1:37863_solr-n_0000000023) closing
[junit4] 2> 609418 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1000a4a697e004f, likely client has closed socket
[junit4] 2> 609418 INFO (jetty-closer-299-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@706874aa{/solr,null,UNAVAILABLE}
[junit4] 2> 609418 INFO (OverseerStateUpdate-72068908751650891-127.0.0.1:37863_solr-n_0000000023) [n:127.0.0.1:37863_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37863_solr
[junit4] 2> 609418 WARN (OverseerAutoScalingTriggerThread-72068908751650891-127.0.0.1:37863_solr-n_0000000023) [n:127.0.0.1:37863_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 609419 INFO (jetty-closer-299-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 609419 DEBUG (jetty-closer-299-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 609419 INFO (jetty-closer-299-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@322dc001{/solr,null,UNAVAILABLE}
[junit4] 2> 609420 INFO (jetty-closer-299-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 609420 INFO (jetty-closer-299-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@21a2cebd{/solr,null,UNAVAILABLE}
[junit4] 2> 609421 INFO (jetty-closer-299-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 609421 ERROR (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 609421 INFO (SUITE-TriggerIntegrationTest-seed#[92571A44F51E1978]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37633 37633
[junit4] 2> 615222 INFO (Thread-295) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37633 37633
[junit4] 2> 615223 WARN (Thread-295) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/aliases.json
[junit4] 2> 42 /solr/clusterprops.json
[junit4] 2> 33 /solr/collections/collection1/terms/shard1
[junit4] 2> 26 /solr/security.json
[junit4] 2> 19 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 14 /solr/collections/testScheduledTrigger/terms/shard1
[junit4] 2> 9 /solr/configs/conf
[junit4] 2> 7 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2> 4 /solr/configs/testScheduledTrigger.AUTOCREATED/managed-schema
[junit4] 2> 3 /solr/configs/testScheduledTrigger.AUTOCREATED
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 51 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 50 /solr/collections/collection1/state.json
[junit4] 2> 42 /solr/clusterstate.json
[junit4] 2> 31 /solr/collections/testScheduledTrigger/state.json
[junit4] 2> 21 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/72068908751650830-127.0.0.1:37453_solr-n_0000000003
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72068908751650845-core_node6-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/72068908751650866-127.0.0.1:33567_solr-n_0000000015
[junit4] 2> 2 /solr/collections/testScheduledTrigger/leader_elect/shard1/election/72068908751650895-core_node6-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72068908751650842-core_node4-n_0000000000
[junit4] 2> 2 /solr/collections/testMetricTrigger/leader_elect/shard1/election/72068908751650881-core_node5-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72068908751650875-127.0.0.1:34247_solr-n_0000000018
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 394 /solr/live_nodes
[junit4] 2> 91 /solr/collections
[junit4] 2> 21 /solr/overseer/queue-work
[junit4] 2> 21 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 21 /solr/overseer/queue
[junit4] 2> 21 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_92571A44F51E1978-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=MockRandom), x_s=FST50}, docValues:{}, maxPointsInLeafNode=1811, maxMBSortInHeap=6.111892255672885, sim=RandomSimilarity(queryNorm=false): {}, locale=gu, timezone=America/Mazatlan
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=1,free=362187336,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TriggerIntegrationTest]
[junit4] Completed [5/5 (2!)] on J0 in 305.04s, 15 tests, 1 failure <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 75 tests, 2 failures [seed: 92571A44F51E1978]
Total time: 10 minutes 20 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 2/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=00a0e146be299be03e51356b511abf45a2ab326b, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1457
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build #
1464 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1464/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseSerialGC
8 tests failed.
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:34409/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:33177/solr/MoveReplicaHDFSTest_failed_coll_true]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:34409/solr/MoveReplicaHDFSTest_failed_coll_true, http://127.0.0.1:33177/solr/MoveReplicaHDFSTest_failed_coll_true]
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:370A90DC31B27664]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:307)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34409/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard2
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
... 45 more
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:370A90DC31B27664]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:301)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalMove
Error Message:
Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:3B1FF489038061AE]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.test
Error Message:
Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:15937CF4289DCE4C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:370A90DC31B27664]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:301)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalMove
Error Message:
Error from server at http://127.0.0.1:37283/solr: delete the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37283/solr: delete the collection time out:180s
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:3B1FF489038061AE]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.test
Error Message:
Error from server at http://127.0.0.1:37283/solr: delete the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37283/solr: delete the collection time out:180s
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:15937CF4289DCE4C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.MoveReplicaHDFSTest.testNormalFailedMove
Error Message:
Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34067/solr: delete the collection time out:180s
at __randomizedtesting.SeedInfo.seed([9DC7432E8661A3B4:BACC5C66AA233DAD]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:451)
at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:95)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12795 lines...]
[junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
[junit4] 2> 289419 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/init-core-data-001
[junit4] 2> 289419 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 289420 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 289420 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001
[junit4] 2> 289420 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 289421 INFO (Thread-708) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 289421 INFO (Thread-708) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 289422 ERROR (Thread-708) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 289521 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41649
[junit4] 2> 289522 INFO (zkConnectionManagerCallback-619-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289525 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+03:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 289525 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+03:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 289525 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+03:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 289525 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+03:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d6c517f{/solr,null,AVAILABLE}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@443142d5{/solr,null,AVAILABLE}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7989cf33{/solr,null,AVAILABLE}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4fa01381{HTTP/1.1,[http/1.1]}{127.0.0.1:37283}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1649d5e8{HTTP/1.1,[http/1.1]}{127.0.0.1:40437}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.e.j.s.Server Started @291010ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.e.j.s.Server Started @291010ms
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37283}
[junit4] 2> 289526 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40437}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5ed0267b{HTTP/1.1,[http/1.1]}{127.0.0.1:38021}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.e.j.s.Server Started @291010ms
[junit4] 2> 289527 ERROR (jetty-launcher-616-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@46536437{/solr,null,AVAILABLE}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38021}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 289527 ERROR (jetty-launcher-616-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 289527 ERROR (jetty-launcher-616-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T13:34:21.973321Z
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@47e715b2{HTTP/1.1,[http/1.1]}{127.0.0.1:43149}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.e.j.s.Server Started @291011ms
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43149}
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T13:34:21.973439Z
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T13:34:21.973524Z
[junit4] 2> 289527 ERROR (jetty-launcher-616-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 289527 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T13:34:21.973778Z
[junit4] 2> 289530 INFO (zkConnectionManagerCallback-621-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289530 INFO (zkConnectionManagerCallback-627-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289530 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 289530 INFO (zkConnectionManagerCallback-625-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289530 INFO (zkConnectionManagerCallback-623-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289530 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 289530 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 289530 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 289533 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100125cc2620002, likely client has closed socket
[junit4] 2> 289534 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100125cc2620003, likely client has closed socket
[junit4] 2> 289535 INFO (jetty-launcher-616-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41649/solr
[junit4] 2> 289535 INFO (jetty-launcher-616-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41649/solr
[junit4] 2> 289535 INFO (jetty-launcher-616-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41649/solr
[junit4] 2> 289535 INFO (jetty-launcher-616-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41649/solr
[junit4] 2> 289536 INFO (zkConnectionManagerCallback-635-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289536 INFO (zkConnectionManagerCallback-641-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289536 INFO (zkConnectionManagerCallback-637-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289537 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100125cc2620006, likely client has closed socket
[junit4] 2> 289537 INFO (zkConnectionManagerCallback-643-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289537 INFO (zkConnectionManagerCallback-649-thread-1-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289538 INFO (zkConnectionManagerCallback-645-thread-1-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289538 INFO (zkConnectionManagerCallback-647-thread-1-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289539 INFO (zkConnectionManagerCallback-651-thread-1-processing-n:127.0.0.1:38021_solr) [n:127.0.0.1:38021_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289578 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 289578 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 289578 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 289578 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 289579 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40437_solr
[junit4] 2> 289579 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38021_solr
[junit4] 2> 289579 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43149_solr
[junit4] 2> 289579 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37283_solr
[junit4] 2> 289580 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.c.Overseer Overseer (id=72077783645421579-127.0.0.1:40437_solr-n_0000000000) starting
[junit4] 2> 289580 INFO (zkCallback-644-thread-1-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 289584 INFO (zkCallback-648-thread-1-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 289584 INFO (zkCallback-650-thread-1-processing-n:127.0.0.1:38021_solr) [n:127.0.0.1:38021_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 289584 INFO (zkCallback-646-thread-1-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 289595 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40437_solr
[junit4] 2> 289595 INFO (zkCallback-650-thread-1-processing-n:127.0.0.1:38021_solr) [n:127.0.0.1:38021_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 289595 INFO (zkCallback-648-thread-1-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 289596 INFO (zkCallback-646-thread-1-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 289596 INFO (zkCallback-644-thread-1-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 289616 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38021.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289620 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43149.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289620 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37283.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289622 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38021.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289622 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38021.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289623 INFO (jetty-launcher-616-thread-2) [n:127.0.0.1:38021_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001/node2/.
[junit4] 2> 289623 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40437.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289637 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40437.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40437.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43149.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37283.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37283.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43149.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 289638 INFO (jetty-launcher-616-thread-3) [n:127.0.0.1:40437_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001/node3/.
[junit4] 2> 289639 INFO (jetty-launcher-616-thread-4) [n:127.0.0.1:37283_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001/node4/.
[junit4] 2> 289639 INFO (jetty-launcher-616-thread-1) [n:127.0.0.1:43149_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001/node1/.
[junit4] 2> 289714 INFO (zkConnectionManagerCallback-661-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289716 INFO (zkConnectionManagerCallback-665-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 289717 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 289718 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41649/solr ready
[junit4] 2> 289721 INFO (qtp1422367737-3225) [n:127.0.0.1:43149_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 289725 INFO (qtp1422367737-3225) [n:127.0.0.1:43149_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 289905 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 290227 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 290299 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 290309 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 290417 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 290438 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_36923_hdfs____.fp6tdb/webapp
[junit4] 2> 290529 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36923
[junit4] 2> 290797 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 290799 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 290802 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_38921_datanode____.g19812/webapp
[junit4] 2> 290866 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38921
[junit4] 2> 290875 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] i.n.u.i.PlatformDependent Your platform does not provide complete low-level API for accessing direct buffers reliably. Unless explicitly requested, heap buffer will always be preferred to avoid potential system unstability.
[junit4] 2> 290995 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 290996 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 291003 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_38985_datanode____.ekv02w/webapp
[junit4] 2> 291071 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38985
[junit4] 2> 291281 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:43967) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 291281 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:43967) [ ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
[junit4] 2> 291318 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1183055b3a07f: from storage DS-81332290-7312-46fa-bd7a-4bd6dbbd2401 node DatanodeRegistration(127.0.0.1:37265, datanodeUuid=bc24080d-14cf-47ba-b9e1-f89e20d2e8a0, infoPort=34825, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-56;cid=testClusterID;nsid=1780595530;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 291318 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1183055b3a0be: from storage DS-81d0dd41-cf43-4821-a4bb-5c805950f308 node DatanodeRegistration(127.0.0.1:35029, datanodeUuid=8300e18c-ad2e-4d8a-87bb-283571dbb85f, infoPort=44647, infoSecurePort=0, ipcPort=44923, storageInfo=lv=-56;cid=testClusterID;nsid=1780595530;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 291318 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1183055b3a07f: from storage DS-2c53caa3-1522-4269-89b6-eadc38a4f12d node DatanodeRegistration(127.0.0.1:37265, datanodeUuid=bc24080d-14cf-47ba-b9e1-f89e20d2e8a0, infoPort=34825, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-56;cid=testClusterID;nsid=1780595530;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 291318 INFO (Block report processor) [ ] BlockStateChange BLOCK* processReport 0x1183055b3a0be: from storage DS-a3b3a960-6246-4202-bf5b-7e96b1c9f369 node DatanodeRegistration(127.0.0.1:35029, datanodeUuid=8300e18c-ad2e-4d8a-87bb-283571dbb85f, infoPort=44647, infoSecurePort=0, ipcPort=44923, storageInfo=lv=-56;cid=testClusterID;nsid=1780595530;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 291355 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testFailedMove
[junit4] 2> 291356 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 291357 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??+03:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 291363 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 291363 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75744f51{/solr,null,AVAILABLE}
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1c954a71{HTTP/1.1,[http/1.1]}{127.0.0.1:46141}
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.e.j.s.Server Started @292848ms
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46141}
[junit4] 2> 291364 ERROR (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 291364 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 291365 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 291365 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 291365 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T13:34:23.811049Z
[junit4] 2> 291371 INFO (zkConnectionManagerCallback-668-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 291371 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 291643 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41649/solr
[junit4] 2> 291645 INFO (zkConnectionManagerCallback-672-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 291647 INFO (zkConnectionManagerCallback-674-thread-1-processing-n:127.0.0.1:46141_solr) [n:127.0.0.1:46141_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 291651 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 291652 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 291653 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46141_solr
[junit4] 2> 291654 INFO (zkCallback-644-thread-1-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291654 INFO (zkCallback-650-thread-1-processing-n:127.0.0.1:38021_solr) [n:127.0.0.1:38021_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291654 INFO (zkCallback-646-thread-1-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291654 INFO (zkCallback-648-thread-1-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291656 INFO (zkCallback-664-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291656 INFO (zkCallback-673-thread-1-processing-n:127.0.0.1:46141_solr) [n:127.0.0.1:46141_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291656 INFO (zkCallback-664-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 291685 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46141.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 291694 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46141.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 291694 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46141.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 291695 INFO (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[9DC7432E8661A3B4]) [n:127.0.0.1:46141_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-001/tempDir-001/node5/.
[junit4] 2> 291723 INFO (OverseerCollectionConfigSetProcessor-72077783645421579-127.0.0.1:40437_solr-n_0000000000) [n:127.0.0.1:40437_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 291743 INFO (zkConnectionManagerCallback-678-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 291746 INFO (qtp42518405-3232) [n:127.0.0.1:37283_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf1&autoAddReplicas=false&name=MoveReplicaHDFSTest_failed_coll_true&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 291747 INFO (OverseerThreadFactory-1290-thread-2-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection MoveReplicaHDFSTest_failed_coll_true
[junit4] 2> 291851 INFO (OverseerStateUpdate-72077783645421579-127.0.0.1:40437_solr-n_0000000000) [n:127.0.0.1:40437_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_true",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40437/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 291852 INFO (OverseerStateUpdate-72077783645421579-127.0.0.1:40437_solr-n_0000000000) [n:127.0.0.1:40437_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_true",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46141/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 291853 INFO (OverseerStateUpdate-72077783645421579-127.0.0.1:40437_solr-n_0000000000) [n:127.0.0.1:40437_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_true",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43149/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 291854 INFO (OverseerStateUpdate-72077783645421579-127.0.0.1:40437_solr-n_0000000000) [n:127.0.0.1:40437_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MoveReplicaHDFSTest_failed_coll_true",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37283/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 292058 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_true&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 292058 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_true&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 292058 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_true&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 292058 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 292058 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 292058 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_failed_coll_true&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 292058 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 292059 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 292162 INFO (zkCallback-673-thread-1-processing-n:127.0.0.1:46141_solr) [n:127.0.0.1:46141_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292162 INFO (zkCallback-646-thread-1-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292162 INFO (zkCallback-648-thread-1-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292162 INFO (zkCallback-644-thread-1-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292162 INFO (zkCallback-673-thread-2-processing-n:127.0.0.1:46141_solr) [n:127.0.0.1:46141_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292163 INFO (zkCallback-646-thread-2-processing-n:127.0.0.1:40437_solr) [n:127.0.0.1:40437_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292163 INFO (zkCallback-648-thread-2-processing-n:127.0.0.1:37283_solr) [n:127.0.0.1:37283_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292163 INFO (zkCallback-644-thread-2-processing-n:127.0.0.1:43149_solr) [n:127.0.0.1:43149_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MoveReplicaHDFSTest_failed_coll_true/state.json] for collection [MoveReplicaHDFSTest_failed_coll_true] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293066 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 293066 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 293067 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 293067 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 293081 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] Schema name=minimal
[junit4] 2> 293081 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] Schema name=minimal
[junit4] 2> 293081 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] Schema name=minimal
[junit4] 2> 293081 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.s.IndexSchema [MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] Schema name=minimal
[junit4] 2> 293083 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 293083 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 293083 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1' using configuration from collection MoveReplicaHDFSTest_failed_coll_true, trusted=true
[junit4] 2> 293083 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2' using configuration from collection MoveReplicaHDFSTest_failed_coll_true, trusted=true
[junit4] 2> 293083 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 293083 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 293083 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6' using configuration from collection MoveReplicaHDFSTest_failed_coll_true, trusted=true
[junit4] 2> 293083 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4' using configuration from collection MoveReplicaHDFSTest_failed_coll_true, trusted=true
[junit4] 2> 293084 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43149.solr.core.MoveReplicaHDFSTest_failed_coll_true.shard2.replica_n4' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_true.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 293084 INFO (qtp1427126457-3227) [n:127.0.0.1:40437_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node3 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40437.solr.core.MoveReplicaHDFSTest_failed_coll_true.shard1.replica_n1' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_true.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 293084 INFO (qtp42518405-3248) [n:127.0.0.1:37283_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37283.solr.core.MoveReplicaHDFSTest_failed_coll_true.shard2.replica_n6' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_true.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 293084 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46141.solr.core.MoveReplicaHDFSTest_failed_coll_true.shard1.replica_n2' (registry 'solr.core.MoveReplicaHDFSTest_failed_coll_true.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e2e1cc0
[junit4] 2> 293092 INFO (qtp1422367737-3255) [n:127.0.0.1:43149_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node7 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:43967/data
[junit4] 2> 293092 INFO (qtp1024065899-3531) [n:127.0.0.1:46141_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard1 r:core_node5 x:MoveReplicaHDFSTest_failed_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:43967/data
[junit4] 2> 293092 INFO (qtp1427126457-3227) [n:127.
[...truncated too long message...]
s DEFAULT, and a client may configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' in its configuration.
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.findNewDatanode(DFSOutputStream.java:1044)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.addDatanode2ExistingPipeline(DFSOutputStream.java:1107)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1276)
[junit4] 2> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:560)
[junit4] 2> 750081 INFO (coreCloseExecutor-228-thread-1) [n:127.0.0.1:39349_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:45321/data/MoveReplicaHDFSTest_failed_coll_true/core_node8/data/index
[junit4] 2> 750081 INFO (coreCloseExecutor-228-thread-1) [n:127.0.0.1:39349_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:45321/data/MoveReplicaHDFSTest_failed_coll_true/core_node8/data
[junit4] 2> 750081 INFO (coreCloseExecutor-228-thread-1) [n:127.0.0.1:39349_solr c:MoveReplicaHDFSTest_failed_coll_true s:shard2 r:core_node8 x:MoveReplicaHDFSTest_failed_coll_true_shard2_replica_n6] o.a.s.s.h.HdfsDirectory Closing hdfs directory hdfs://localhost.localdomain:45321/data/MoveReplicaHDFSTest_failed_coll_true/core_node8/data/snapshot_metadata
[junit4] 2> 750082 INFO (jetty-closer-89-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@743e7a59{/solr,null,UNAVAILABLE}
[junit4] 2> 750082 INFO (jetty-closer-89-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 750083 ERROR (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 750083 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41381 41381
[junit4] 2> 764930 INFO (Thread-1895) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41381 41381
[junit4] 2> 764931 WARN (Thread-1895) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections/MoveReplicaHDFSTest_failed_coll_true/terms/shard2
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 7 /solr/collections/MoveReplicaHDFSTest_failed_coll_true/terms/shard1
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 424 /solr/collections/MoveReplicaHDFSTest_failed_coll_true/state.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 3 /solr/overseer_elect/election/72077961888530444-127.0.0.1:34067_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72077961888530443-127.0.0.1:42217_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 11 /solr/collections
[junit4] 2>
[junit4] 2> 764931 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 764973 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 765073 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:45321) [ ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
[junit4] 2> 765073 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data4/]] heartbeating to localhost.localdomain/127.0.0.1:45321) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-990980284-88.99.242.108-1520173182230 (Datanode Uuid 017ee907-f9e2-4932-aad5-d3f9d9facaa2) service to localhost.localdomain/127.0.0.1:45321
[junit4] 2> 765075 WARN (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
[junit4] 2> 765078 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
[junit4] 2> 765179 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:45321) [ ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
[junit4] 2> 765179 WARN (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost.localdomain/127.0.0.1:45321) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-990980284-88.99.242.108-1520173182230 (Datanode Uuid ba1a86c6-c660-4c48-b50f-7fb708a376cf) service to localhost.localdomain/127.0.0.1:45321
[junit4] 2> 765183 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
[junit4] 2> 765294 INFO (SUITE-MoveReplicaHDFSTest-seed#[9DC7432E8661A3B4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41381 41381
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_9DC7432E8661A3B4-002
[junit4] 2> Mar 04, 2018 2:30:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 65 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, maxPointsInLeafNode=1645, maxMBSortInHeap=5.958391604094842, sim=RandomSimilarity(queryNorm=false): {}, locale=en-VI, timezone=Asia/Urumqi
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 10 (64-bit)/cpus=8,threads=2,free=296328592,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [MoveReplicaHDFSTest, MoveReplicaHDFSTest]
[junit4] Completed [5/5 (2!)] on J1 in 683.31s, 4 tests, 1 failure, 3 errors <<< FAILURES!
[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 20 tests, 4 errors, 1 failure [seed: 9DC7432E8661A3B4]
Total time: 12 minutes 57 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 2/5 failed: org.apache.solr.cloud.MoveReplicaHDFSTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=59f67468b7f9f90f2377033d358521d451508f9a, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1463
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1463
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1463/
Java: 32bit/jdk1.8.0_162 -server -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
Error Message:
Error from server at https://127.0.0.1:46161/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:46161/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([848B96C08D9B4183:277138650A73AB26]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:550)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1013)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:946)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:169)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46161/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/testcollection_shard1_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.8.v20171121</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:527)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Build Log:
[...truncated 12635 lines...]
[junit4] Suite: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster
[junit4] 2> 497031 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[848B96C08D9B4183]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/init-core-data-001
[junit4] 2> 497032 WARN (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[848B96C08D9B4183]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 497032 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[848B96C08D9B4183]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 497034 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[848B96C08D9B4183]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 497036 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001
[junit4] 2> 497036 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 497036 INFO (Thread-1067) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 497036 INFO (Thread-1067) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 497039 ERROR (Thread-1067) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 497136 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.ZkTestServer start zk server on port:43865
[junit4] 2> 497138 INFO (zkConnectionManagerCallback-4758-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497142 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497142 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497142 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497142 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497142 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497144 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497144 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497144 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 497145 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b62389{/solr,null,AVAILABLE}
[junit4] 2> 497149 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497149 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497149 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 497152 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9e25ed{/solr,null,AVAILABLE}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@486e02{/solr,null,AVAILABLE}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.AbstractConnector Started ServerConnector@75a6c5{SSL,[ssl, http/1.1]}{127.0.0.1:46161}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.e.j.s.Server Started @498594ms
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46161}
[junit4] 2> 497153 ERROR (jetty-launcher-4755-thread-5) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.229Z
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@160b90e{SSL,[ssl, http/1.1]}{127.0.0.1:34951}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15d0c0{SSL,[ssl, http/1.1]}{127.0.0.1:45415}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-2) [ ] o.e.j.s.Server Started @498595ms
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-4) [ ] o.e.j.s.Server Started @498595ms
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34951}
[junit4] 2> 497153 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45415}
[junit4] 2> 497153 ERROR (jetty-launcher-4755-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497153 ERROR (jetty-launcher-4755-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.230Z
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a32e25{/solr,null,AVAILABLE}
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.230Z
[junit4] 2> 497154 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e4748c{/solr,null,AVAILABLE}
[junit4] 2> 497159 INFO (zkConnectionManagerCallback-4762-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@11a7e57{SSL,[ssl, http/1.1]}{127.0.0.1:42177}
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.e.j.s.Server Started @498601ms
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42177}
[junit4] 2> 497160 ERROR (jetty-launcher-4755-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497160 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.236Z
[junit4] 2> 497166 INFO (zkConnectionManagerCallback-4764-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62d910{SSL,[ssl, http/1.1]}{127.0.0.1:46109}
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-1) [ ] o.e.j.s.Server Started @498608ms
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46109}
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497166 ERROR (jetty-launcher-4755-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497166 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497167 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497167 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.243Z
[junit4] 2> 497169 INFO (zkConnectionManagerCallback-4766-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497170 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497173 INFO (zkConnectionManagerCallback-4760-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497174 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497181 INFO (zkConnectionManagerCallback-4768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497184 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497186 INFO (jetty-launcher-4755-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497187 INFO (jetty-launcher-4755-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497187 INFO (jetty-launcher-4755-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497193 INFO (jetty-launcher-4755-thread-5) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497193 INFO (zkConnectionManagerCallback-4774-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497193 INFO (zkConnectionManagerCallback-4777-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497196 INFO (zkConnectionManagerCallback-4787-thread-1-processing-n:127.0.0.1:34951_solr) [n:127.0.0.1:34951_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497196 INFO (zkConnectionManagerCallback-4784-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497196 INFO (jetty-launcher-4755-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497196 INFO (zkConnectionManagerCallback-4781-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497213 INFO (zkConnectionManagerCallback-4792-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497213 INFO (zkConnectionManagerCallback-4789-thread-1-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497217 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497217 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42177_solr
[junit4] 2> 497217 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.c.Overseer Overseer (id=72075685329895435-127.0.0.1:42177_solr-n_0000000000) starting
[junit4] 2> 497224 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497225 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34951_solr
[junit4] 2> 497238 INFO (zkCallback-4786-thread-1-processing-n:127.0.0.1:34951_solr) [n:127.0.0.1:34951_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 497241 INFO (zkConnectionManagerCallback-4796-thread-1-processing-n:127.0.0.1:45415_solr) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497241 INFO (zkConnectionManagerCallback-4797-thread-1-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497245 INFO (zkCallback-4788-thread-1-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 497247 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42177_solr
[junit4] 2> 497249 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 497249 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 497250 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497250 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497250 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46161_solr
[junit4] 2> 497251 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45415_solr
[junit4] 2> 497257 INFO (zkConnectionManagerCallback-4801-thread-1-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497260 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 497260 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497261 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46109_solr
[junit4] 2> 497272 INFO (zkCallback-4786-thread-1-processing-n:127.0.0.1:34951_solr) [n:127.0.0.1:34951_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (5)
[junit4] 2> 497273 INFO (zkCallback-4788-thread-1-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (5)
[junit4] 2> 497290 INFO (zkCallback-4795-thread-1-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (5)
[junit4] 2> 497290 INFO (zkCallback-4800-thread-1-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497294 INFO (zkCallback-4794-thread-1-processing-n:127.0.0.1:45415_solr) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (5)
[junit4] 2> 497308 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34951.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497315 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34951.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497315 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34951.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497316 INFO (jetty-launcher-4755-thread-2) [n:127.0.0.1:34951_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node2/.
[junit4] 2> 497344 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46161.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497350 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46161.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497350 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46161.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497350 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42177.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497351 INFO (jetty-launcher-4755-thread-5) [n:127.0.0.1:46161_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node5/.
[junit4] 2> 497357 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42177.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497357 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42177.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497359 INFO (jetty-launcher-4755-thread-3) [n:127.0.0.1:42177_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node3/.
[junit4] 2> 497369 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45415.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497375 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45415.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497375 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45415.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497375 INFO (jetty-launcher-4755-thread-4) [n:127.0.0.1:45415_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node4/.
[junit4] 2> 497392 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46109.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497398 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46109.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497398 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46109.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497398 INFO (jetty-launcher-4755-thread-1) [n:127.0.0.1:46109_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node1/.
[junit4] 2> 497472 INFO (zkConnectionManagerCallback-4810-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497474 INFO (zkConnectionManagerCallback-4814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497475 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 497475 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43865/solr ready
[junit4] 2> 497476 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionCreateSearchDelete
[junit4] 2> 497477 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@160b90e{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 497477 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=12919408
[junit4] 2> 497477 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 497477 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10b059: rootName = solr_34951, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@17ac95d
[junit4] 2> 497483 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 497483 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1541a10: rootName = solr_34951, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@bf22f
[junit4] 2> 497486 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 497486 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6b725: rootName = solr_34951, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1fbe85b
[junit4] 2> 497487 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34951_solr
[junit4] 2> 497488 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 497488 INFO (zkCallback-4788-thread-2-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497488 INFO (zkCallback-4786-thread-1-processing-n:127.0.0.1:34951_solr) [n:127.0.0.1:34951_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497488 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 497488 INFO (zkCallback-4794-thread-1-processing-n:127.0.0.1:45415_solr) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497488 INFO (zkCallback-4800-thread-1-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497488 INFO (zkCallback-4795-thread-1-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497488 INFO (zkCallback-4813-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 497489 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@486e02{/solr,null,UNAVAILABLE}
[junit4] 2> 497489 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 497490 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1441afb{/solr,null,AVAILABLE}
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@13849ae{SSL,[ssl, http/1.1]}{127.0.0.1:39809}
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.e.j.s.Server Started @498933ms
[junit4] 2> 497491 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39809}
[junit4] 2> 497492 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 497492 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 497492 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 497492 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 497492 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-04T04:40:44.568Z
[junit4] 2> 497493 INFO (zkConnectionManagerCallback-4816-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497493 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 497502 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43865/solr
[junit4] 2> 497503 INFO (zkConnectionManagerCallback-4820-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497504 INFO (zkConnectionManagerCallback-4822-thread-1-processing-n:127.0.0.1:39809_solr) [n:127.0.0.1:39809_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 497507 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 497507 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 497508 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39809_solr
[junit4] 2> 497509 INFO (zkCallback-4813-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497509 INFO (zkCallback-4788-thread-2-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497509 INFO (zkCallback-4794-thread-1-processing-n:127.0.0.1:45415_solr) [n:127.0.0.1:45415_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497510 INFO (zkCallback-4795-thread-1-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497510 INFO (zkCallback-4800-thread-1-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497514 INFO (zkCallback-4821-thread-1-processing-n:127.0.0.1:39809_solr) [n:127.0.0.1:39809_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 497576 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39809.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497583 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39809.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497583 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39809.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 497584 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[848B96C08D9B4183]) [n:127.0.0.1:39809_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node6/.
[junit4] 2> 497682 INFO (qtp19872372-11703) [n:127.0.0.1:39809_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=769b2edc-cd67-4cba-8996-06ee49175473&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 497683 INFO (qtp19872372-11703) [n:127.0.0.1:39809_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=769b2edc-cd67-4cba-8996-06ee49175473&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 497685 INFO (qtp19872372-11701) [n:127.0.0.1:39809_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=769b2edc-cd67-4cba-8996-06ee49175473&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 497685 INFO (OverseerThreadFactory-2402-thread-1-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testcollection
[junit4] 2> 497685 INFO (qtp19872372-11701) [n:127.0.0.1:39809_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=769b2edc-cd67-4cba-8996-06ee49175473&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 497788 INFO (OverseerStateUpdate-72075685329895435-127.0.0.1:42177_solr-n_0000000000) [n:127.0.0.1:42177_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46109/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 497790 INFO (OverseerStateUpdate-72075685329895435-127.0.0.1:42177_solr-n_0000000000) [n:127.0.0.1:42177_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46161/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 497791 INFO (OverseerStateUpdate-72075685329895435-127.0.0.1:42177_solr-n_0000000000) [n:127.0.0.1:42177_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39809/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 497793 INFO (OverseerStateUpdate-72075685329895435-127.0.0.1:42177_solr-n_0000000000) [n:127.0.0.1:42177_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42177/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 498006 INFO (qtp19872372-11702) [n:127.0.0.1:39809_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051961472944&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=8
[junit4] 2> 498006 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051961472944&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
[junit4] 2> 498007 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 498042 INFO (qtp29150820-11588) [n:127.0.0.1:46161_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051960324444&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1
[junit4] 2> 498042 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051960324444&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
[junit4] 2> 498042 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 498045 INFO (qtp17248207-11595) [n:127.0.0.1:42177_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051962379511&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=3
[junit4] 2> 498046 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051962379511&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
[junit4] 2> 498046 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 498048 INFO (qtp30869035-11600) [n:127.0.0.1:46109_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051959014317&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
[junit4] 2> 498048 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=769b2edc-cd67-4cba-8996-06ee49175473276051959014317&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
[junit4] 2> 498048 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 498050 INFO (qtp17248207-11603) [n:127.0.0.1:42177_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 769b2edc-cd67-4cba-8996-06ee49175473276051962379511
[junit4] 2> 498050 INFO (qtp17248207-11603) [n:127.0.0.1:42177_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=769b2edc-cd67-4cba-8996-06ee49175473276051962379511&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 498152 INFO (zkCallback-4795-thread-1-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4821-thread-1-processing-n:127.0.0.1:39809_solr) [n:127.0.0.1:39809_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4788-thread-1-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4795-thread-2-processing-n:127.0.0.1:46161_solr) [n:127.0.0.1:46161_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4821-thread-2-processing-n:127.0.0.1:39809_solr) [n:127.0.0.1:39809_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4800-thread-2-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4788-thread-2-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498152 INFO (zkCallback-4800-thread-1-processing-n:127.0.0.1:46109_solr) [n:127.0.0.1:46109_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 498688 INFO (qtp17248207-11602) [n:127.0.0.1:42177_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=769b2edc-cd67-4cba-8996-06ee49175473&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 498689 INFO (qtp17248207-11602) [n:127.0.0.1:42177_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=769b2edc-cd67-4cba-8996-06ee49175473&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 499015 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 499019 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.IndexSchema [testcollection_shard2_replica_n4] Schema name=minimal
[junit4] 2> 499026 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 499026 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n4' using configuration from collection testcollection, trusted=true
[junit4] 2> 499026 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39809.solr.core.testcollection.shard2.replica_n4' (registry 'solr.core.testcollection.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 499026 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 499026 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore [[testcollection_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node6/testcollection_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node6/./testcollection_shard2_replica_n4/data/]
[junit4] 2> 499051 INFO (qtp17248207-11595) [n:127.0.0.1:42177_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 769b2edc-cd67-4cba-8996-06ee49175473276051962379511
[junit4] 2> 499051 INFO (qtp17248207-11595) [n:127.0.0.1:42177_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=769b2edc-cd67-4cba-8996-06ee49175473276051962379511&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 499056 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 499056 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 499056 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 499061 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.IndexSchema [testcollection_shard1_replica_n2] Schema name=minimal
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n2' using configuration from collection testcollection, trusted=true
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.IndexSchema [testcollection_shard2_replica_n6] Schema name=minimal
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46161.solr.core.testcollection.shard1.replica_n2' (registry 'solr.core.testcollection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema [testcollection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 499063 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore [[testcollection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node5/testcollection_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node5/./testcollection_shard1_replica_n2/data/]
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n6' using configuration from collection testcollection, trusted=true
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42177.solr.core.testcollection.shard2.replica_n6' (registry 'solr.core.testcollection.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n1' using configuration from collection testcollection, trusted=true
[junit4] 2> 499065 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore [[testcollection_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node3/testcollection_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node3/./testcollection_shard2_replica_n6/data/]
[junit4] 2> 499073 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46109.solr.core.testcollection.shard1.replica_n1' (registry 'solr.core.testcollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@11f489c
[junit4] 2> 499073 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 499073 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [[testcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node1/testcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001/tempDir-001/node1/./testcollection_shard1_replica_n1/data/]
[junit4] 2> 499142 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 499142 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 499142 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 499142 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 499143 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 499143 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 499143 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 499143 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 499144 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@84d805[testcollection_shard2_replica_n6] main]
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@13fcbf4[testcollection_shard2_replica_n4] main]
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 499145 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593980691385679872
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 499146 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 499147 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 499147 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 499147 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b8a33[testcollection_shard1_replica_n1] main]
[junit4] 2> 499147 INFO (searcherExecutor-2420-thread-1-processing-x:testcollection_shard2_replica_n4 r:core_node7 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE n:127.0.0.1:39809_solr s:shard2 c:testcollection) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SolrCore [testcollection_shard2_replica_n4] Registered new searcher Searcher@13fcbf4[testcollection_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 499148 INFO (searcherExecutor-2422-thread-1-processing-x:testcollection_shard2_replica_n6 r:core_node8 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE n:127.0.0.1:42177_solr s:shard2 c:testcollection) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore [testcollection_shard2_replica_n6] Registered new searcher Searcher@84d805[testcollection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 499148 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e41b35[testcollection_shard1_replica_n2] main]
[junit4] 2> 499148 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 499148 INFO (parallelCoreAdminExecutor-2406-thread-1-processing-n:127.0.0.1:42177_solr 769b2edc-cd67-4cba-8996-06ee49175473276051962379511 CREATE) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593980691387777024
[junit4] 2> 499148 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 499149 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 499149 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 499149 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 499149 INFO (parallelCoreAdminExecutor-2411-thread-1-processing-n:127.0.0.1:46109_solr 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593980691388825600
[junit4] 2> 499149 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 499150 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593980691389874176
[junit4] 2> 499150 INFO (searcherExecutor-2423-thread-1-processing-x:testcollection_shard1_replica_n1 r:core_node3 769b2edc-cd67-4cba-8996-06ee49175473276051959014317 CREATE n:127.0.0.1:46109_solr s:shard1 c:testcollection) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@6b8a33[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 499151 INFO (searcherExecutor-2421-thread-1-processing-x:testcollection_shard1_replica_n2 r:core_node5 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE n:127.0.0.1:46161_solr s:shard1 c:testcollection) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SolrCore [testcollection_shard1_replica_n2] Registered new searcher Searcher@1e41b35[testcollection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 499152 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying
[junit4] 2> 499153 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 499153 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 499153 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39809/solr/testcollection_shard2_replica_n4/
[junit4] 2> 499154 INFO (parallelCoreAdminExecutor-2418-thread-1-processing-n:127.0.0.1:39809_solr 769b2edc-cd67-4cba-8996-06ee49175473276051961472944 CREATE) [n:127.0.0.1:39809_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n4 url=https://127.0.0.1:39809/solr START replicas=[https://127.0.0.1:42177/solr/testcollection_shard2_replica_n6/] nUpdates=100
[junit4] 2> 499154 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 499154 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 499154 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:46161/solr/testcollection_shard1_replica_n2/
[junit4] 2> 499155 INFO (parallelCoreAdminExecutor-2405-thread-1-processing-n:127.0.0.1:46161_solr 769b2edc-cd67-4cba-8996-06ee49175473276051960324444 CREATE) [n:127.0.0.1:46161_solr c:testcollection s:shard1 r:core_node5 x:testcollection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n2 url=https://127.0.0.1:46161/solr START replicas=[https://127.0.0.1:46109/solr/testcollection_shard1_replica_n1/] nUpdates=100
[junit4] 2> 499157 INFO (qtp17248207-11595) [n:127.0.0.1:42177_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.S.Request [testcollection_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 499160 INFO (qtp30869035-11600) [n:127.0.0.1:46109_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.S.Request [testcollection_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 499259 INFO (zkCallback-4788-thread-2-processing-n:127.0.0.1:42177_solr) [n:127.0.0.1:42177_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/c
[...truncated too long message...]
:34623_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 527282 INFO (zkCallback-4981-thread-1-processing-n:127.0.0.1:33817_solr) [n:127.0.0.1:33817_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 527283 INFO (zkCallback-4991-thread-1-processing-n:127.0.0.1:35675_solr) [n:127.0.0.1:35675_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 527283 INFO (jetty-closer-4896-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 527283 INFO (jetty-closer-4896-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 527283 INFO (jetty-closer-4896-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72075686482411532-127.0.0.1:34623_solr-n_0000000002) closing
[junit4] 2> 527283 INFO (OverseerStateUpdate-72075686482411532-127.0.0.1:34623_solr-n_0000000002) [n:127.0.0.1:34623_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34623_solr
[junit4] 2> 527283 WARN (OverseerAutoScalingTriggerThread-72075686482411532-127.0.0.1:34623_solr-n_0000000002) [n:127.0.0.1:34623_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 527285 INFO (zkCallback-4961-thread-2-processing-n:127.0.0.1:41069_solr) [n:127.0.0.1:41069_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41069_solr
[junit4] 2> 527286 INFO (jetty-closer-4896-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@91e78c{/solr,null,UNAVAILABLE}
[junit4] 2> 527286 INFO (jetty-closer-4896-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 527294 INFO (coreCloseExecutor-2629-thread-1) [n:127.0.0.1:33817_solr c:testStopAllStartAllCollection s:shard2 r:core_node8 x:testStopAllStartAllCollection_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testStopAllStartAllCollection.shard2.leader, tag=3455083
[junit4] 2> 527296 INFO (coreCloseExecutor-2632-thread-1) [n:127.0.0.1:35675_solr c:testStopAllStartAllCollection s:shard1 r:core_node3 x:testStopAllStartAllCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testStopAllStartAllCollection.shard1.leader, tag=20441666
[junit4] 2> 527297 INFO (coreCloseExecutor-2630-thread-1) [n:127.0.0.1:46705_solr c:testStopAllStartAllCollection s:shard1 r:core_node5 x:testStopAllStartAllCollection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testStopAllStartAllCollection.shard1.leader, tag=680071
[junit4] 2> 527298 INFO (coreCloseExecutor-2631-thread-1) [n:127.0.0.1:41069_solr c:testStopAllStartAllCollection s:shard2 r:core_node7 x:testStopAllStartAllCollection_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testStopAllStartAllCollection.shard2.leader, tag=21281452
[junit4] 2> 527299 INFO (jetty-closer-4896-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@162665b{/solr,null,UNAVAILABLE}
[junit4] 2> 527299 INFO (jetty-closer-4896-thread-5) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 527300 INFO (jetty-closer-4896-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@87827d{/solr,null,UNAVAILABLE}
[junit4] 2> 527300 INFO (jetty-closer-4896-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 527302 INFO (jetty-closer-4896-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@133747f{/solr,null,UNAVAILABLE}
[junit4] 2> 527302 INFO (jetty-closer-4896-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 528802 INFO (jetty-closer-4896-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d03fe5{/solr,null,UNAVAILABLE}
[junit4] 2> 528802 INFO (jetty-closer-4896-thread-3) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 528803 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[848B96C08D9B4183]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 528803 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[848B96C08D9B4183]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41609 41609
[junit4] 2> 528831 INFO (Thread-1199) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41609 41609
[junit4] 2> 528831 WARN (Thread-1199) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2> 8 /solr/configs/solrCloudCollectionConfig
[junit4] 2> 7 /solr/collections/testStopAllStartAllCollection/terms/shard2
[junit4] 2> 7 /solr/collections/testStopAllStartAllCollection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 78 /solr/collections/testStopAllStartAllCollection/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/72075686482411532-127.0.0.1:34623_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/live_nodes
[junit4] 2> 10 /solr/collections
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 528831 INFO (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[848B96C08D9B4183]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStopAllStartAll
[junit4] 2> 528832 INFO (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[848B96C08D9B4183]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41609 41609
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster_848B96C08D9B4183-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=sk, timezone=SystemV/MST7
[junit4] 2> NOTE: Linux 4.13.0-36-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=200655440,total=356253696
[junit4] 2> NOTE: All tests run in this JVM: [TestDistribDocBasedVersion, SolrTestCaseJ4Test, SolrXmlInZkTest, ConnectionManagerTest, BitVectorTest, TestRebalanceLeaders, TestSubQueryTransformerDistrib, LukeRequestHandlerTest, HdfsChaosMonkeySafeLeaderTest, SearchHandlerTest, TestFieldCache, TestJavabinTupleStreamParser, NoCacheHeaderTest, AnalyticsQueryTest, SolrJmxReporterTest, TestPullReplicaErrorHandling, TestLRUStatsCache, RecoveryAfterSoftCommitTest, TestConfigSets, WordBreakSolrSpellCheckerTest, AutoscalingHistoryHandlerTest, IndexSchemaRuntimeFieldTest, DistributedQueueTest, SortSpecParsingTest, TestStressLiveNodes, TestJsonRequest, ConcurrentDeleteAndCreateCollectionTest, TestCoreBackup, ShowFileRequestHandlerTest, TestTolerantUpdateProcessorRandomCloud, UUIDUpdateProcessorFallbackTest, NumericFieldsTest, URLClassifyProcessorTest, CoreMergeIndexesAdminHandlerTest, TestTrieFacet, DisMaxRequestHandlerTest, SolrIndexMetricsTest, DocValuesMultiTest, TestSolrCloudWithSecureImpersonation, TestDynamicFieldCollectionResource, SharedFSAutoReplicaFailoverTest, UninvertDocValuesMergePolicyTest, TestNestedDocsSort, TestReloadAndDeleteDocs, TestRestManager, TestComputePlanAction, FileBasedSpellCheckerTest, TestDistributedStatsComponentCardinality, DateMathParserTest, OverseerCollectionConfigSetProcessorTest, TestComplexPhraseLeadingWildcard, TestSolrCoreSnapshots, TestReloadDeadlock, TestMinMaxOnMultiValuedField, CollectionsAPISolrJTest, ReturnFieldsTest, TestConfigOverlay, TestPayloadScoreQParserPlugin, TestSystemCollAutoCreate, ZkShardTermsTest, JvmMetricsTest, TestReplicaProperties, PreAnalyzedUpdateProcessorTest, TestCollectionsAPIViaSolrCloudCluster]
[junit4] Completed [164/778 (1!)] on J2 in 31.83s, 3 tests, 1 error <<< FAILURES!
[...truncated 45841 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1463/consoleText
[repro] Revision: 1a3468b87282a97222243b7176d9eaeb603e4968
[repro] Ant options: "-Dargs=-server -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=TestCollectionsAPIViaSolrCloudCluster -Dtests.method=testCollectionCreateSearchDelete -Dtests.seed=848B96C08D9B4183 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=SystemV/MST7 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCollectionsAPIViaSolrCloudCluster
[repro] ant compile-test
[...truncated 3310 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCollectionsAPIViaSolrCloudCluster" -Dtests.showOutput=onerror "-Dargs=-server -XX:+UseParallelGC" -Dtests.seed=848B96C08D9B4183 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=SystemV/MST7 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 81 lines...]
[repro] Failures:
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.TestCollectionsAPIViaSolrCloudCluster
[repro] Exiting with code 0
[...truncated 40 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_162) - Build # 1462
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1462/
Java: 64bit/jdk1.8.0_162 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test
Error Message:
null
Stack Trace:
java.lang.NumberFormatException: null
at __randomizedtesting.SeedInfo.seed([25C957257CBB2CC0:AD9D68FFD2474138]:0)
at java.lang.Long.parseLong(Long.java:552)
at java.lang.Long.parseLong(Long.java:631)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForReplicationFromReplicas(AbstractFullDistribZkTestBase.java:2134)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:210)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test
Error Message:
null
Stack Trace:
java.lang.NumberFormatException: null
at __randomizedtesting.SeedInfo.seed([25C957257CBB2CC0:AD9D68FFD2474138]:0)
at java.lang.Long.parseLong(Long.java:552)
at java.lang.Long.parseLong(Long.java:631)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForReplicationFromReplicas(AbstractFullDistribZkTestBase.java:2134)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:210)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13559 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
[junit4] 2> 1788660 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[25C957257CBB2CC0]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/init-core-data-001
[junit4] 2> 1788661 WARN (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[25C957257CBB2CC0]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 1788661 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[25C957257CBB2CC0]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1788662 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[25C957257CBB2CC0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1788662 INFO (SUITE-ChaosMonkeySafeLeaderWithPullReplicasTest-seed#[25C957257CBB2CC0]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /fuhmz/qu
[junit4] 2> 1788662 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ChaosMonkeySafeLeaderWithPullReplicasTest Starting ChaosMonkey test with 2 shards and 6 nodes
[junit4] 2> 1788664 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1788664 INFO (Thread-7612) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1788664 INFO (Thread-7612) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1788665 ERROR (Thread-7612) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1788764 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkTestServer start zk server on port:38413
[junit4] 2> 1788766 INFO (zkConnectionManagerCallback-3182-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788768 INFO (zkConnectionManagerCallback-3184-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788770 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1788771 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1788772 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1788772 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1788773 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1788773 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1788773 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1788774 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1788774 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1788775 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1788775 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1788775 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 1788838 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1788839 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1788839 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1788839 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1788839 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7664fa87{/fuhmz/qu,null,AVAILABLE}
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6df35e09{HTTP/1.1,[http/1.1]}{127.0.0.1:35485}
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server Started @1790236ms
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/tempDir-001/control/data, replicaType=NRT, hostContext=/fuhmz/qu, hostPort=35485, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/control-001/cores}
[junit4] 2> 1788840 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1788840 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T23:36:29.596Z
[junit4] 2> 1788841 INFO (zkConnectionManagerCallback-3186-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788842 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1788842 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/control-001/solr.xml
[junit4] 2> 1788844 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1788845 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1788845 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1788847 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38413/solr
[junit4] 2> 1788848 INFO (zkConnectionManagerCallback-3190-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788850 INFO (zkConnectionManagerCallback-3192-thread-1-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788880 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1788880 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35485_fuhmz%2Fqu
[junit4] 2> 1788881 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer (id=72074488990334980-127.0.0.1:35485_fuhmz%2Fqu-n_0000000000) starting
[junit4] 2> 1788883 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35485_fuhmz%2Fqu
[junit4] 2> 1788884 INFO (zkCallback-3191-thread-1-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1788940 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1788945 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1788945 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1788946 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/control-001/cores
[junit4] 2> 1788959 INFO (zkConnectionManagerCallback-3198-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1788959 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1788960 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38413/solr ready
[junit4] 2> 1788960 INFO (qtp915944677-19613) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35485_fuhmz%252Fqu&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1788962 INFO (OverseerThreadFactory-7200-thread-1-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1789067 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1789067 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1789170 INFO (zkCallback-3191-thread-1-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1790512 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1790520 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1790577 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1790584 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1790585 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1790585 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1790585 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1790587 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1790604 WARN (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1790643 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1790643 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1790644 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1790644 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1790645 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1436976361, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1790646 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@185ea8c6[control_collection_shard1_replica_n1] main]
[junit4] 2> 1790646 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1790647 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1790647 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1790647 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593961549820592128
[junit4] 2> 1790648 INFO (searcherExecutor-7203-thread-1-processing-n:127.0.0.1:35485_fuhmz%2Fqu x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@185ea8c6[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35485/fuhmz/qu/control_collection_shard1_replica_n1/
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35485/fuhmz/qu/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1790651 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1790652 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35485/fuhmz/qu/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1790753 INFO (zkCallback-3191-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1790803 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1790804 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1737
[junit4] 2> 1790806 INFO (qtp915944677-19613) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1790905 INFO (zkCallback-3191-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1790963 INFO (OverseerCollectionConfigSetProcessor-72074488990334980-127.0.0.1:35485_fuhmz%2Fqu-n_0000000000) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1791806 INFO (qtp915944677-19613) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35485_fuhmz%252Fqu&wt=javabin&version=2} status=0 QTime=2845
[junit4] 2> 1791809 INFO (zkConnectionManagerCallback-3202-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1791809 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1791810 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38413/solr ready
[junit4] 2> 1791810 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1791810 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1791811 INFO (OverseerThreadFactory-7200-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1791812 WARN (OverseerThreadFactory-7200-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1792015 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1792015 INFO (qtp915944677-19619) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=205
[junit4] 2> 1792087 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001 of type TLOG
[junit4] 2> 1792087 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40f18e09{/fuhmz/qu,null,AVAILABLE}
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@40259962{HTTP/1.1,[http/1.1]}{127.0.0.1:36477}
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server Started @1793485ms
[junit4] 2> 1792089 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/fuhmz/qu, hostPort=36477, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001/cores}
[junit4] 2> 1792089 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1792090 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1792090 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1792090 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1792090 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T23:36:32.846Z
[junit4] 2> 1792091 INFO (zkConnectionManagerCallback-3204-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1792091 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1792091 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001/solr.xml
[junit4] 2> 1792094 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1792094 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1792095 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1792097 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38413/solr
[junit4] 2> 1792098 INFO (zkConnectionManagerCallback-3208-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1792099 INFO (zkConnectionManagerCallback-3210-thread-1-processing-n:127.0.0.1:36477_fuhmz%2Fqu) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1792102 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1792103 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1792103 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36477_fuhmz%2Fqu
[junit4] 2> 1792104 INFO (zkCallback-3191-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1792104 INFO (zkCallback-3201-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1792104 INFO (zkCallback-3209-thread-1-processing-n:127.0.0.1:36477_fuhmz%2Fqu) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1792141 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1792151 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1792152 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1792153 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001/cores
[junit4] 2> 1792172 INFO (qtp915944677-19648) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36477_fuhmz%252Fqu&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1792173 INFO (OverseerCollectionConfigSetProcessor-72074488990334980-127.0.0.1:35485_fuhmz%2Fqu-n_0000000000) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1792173 INFO (OverseerThreadFactory-7200-thread-3-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:36477_fuhmz%2Fqu for creating new replica
[junit4] 2> 1792174 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1792175 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1793185 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1793194 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 1793255 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1793262 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 1793263 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1793263 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1793263 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 1793265 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1793283 WARN (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1793309 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1793309 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1793310 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1793310 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1793312 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1436976361, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1793312 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@65f7aed4[collection1_shard2_replica_t41] main]
[junit4] 2> 1793313 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1793313 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1793313 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1793314 INFO (searcherExecutor-7214-thread-1-processing-n:127.0.0.1:36477_fuhmz%2Fqu x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@65f7aed4[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1793314 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593961552617144320
[junit4] 2> 1793318 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36477/fuhmz/qu/collection1_shard2_replica_t41/
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:36477/fuhmz/qu/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1793319 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 1793320 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36477/fuhmz/qu/collection1_shard2_replica_t41/ shard2
[junit4] 2> 1793470 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1793472 INFO (qtp1788755826-19665) [n:127.0.0.1:36477_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1297
[junit4] 2> 1793473 INFO (qtp915944677-19648) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36477_fuhmz%252Fqu&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1301
[junit4] 2> 1793548 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001 of type TLOG
[junit4] 2> 1793549 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1793549 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1793549 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1793549 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e83c682{/fuhmz/qu,null,AVAILABLE}
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7d5477e4{HTTP/1.1,[http/1.1]}{127.0.0.1:35029}
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server Started @1794946ms
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/fuhmz/qu, hostPort=35029, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001/cores}
[junit4] 2> 1793550 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1793550 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T23:36:34.306Z
[junit4] 2> 1793551 INFO (zkConnectionManagerCallback-3214-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1793552 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1793552 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001/solr.xml
[junit4] 2> 1793554 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1793554 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1793555 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1793559 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38413/solr
[junit4] 2> 1793561 INFO (zkConnectionManagerCallback-3218-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1793565 INFO (zkConnectionManagerCallback-3220-thread-1-processing-n:127.0.0.1:35029_fuhmz%2Fqu) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1793568 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1793568 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1793569 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35029_fuhmz%2Fqu
[junit4] 2> 1793569 INFO (zkCallback-3201-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1793569 INFO (zkCallback-3209-thread-1-processing-n:127.0.0.1:36477_fuhmz%2Fqu) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1793569 INFO (zkCallback-3191-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1793574 INFO (zkCallback-3219-thread-1-processing-n:127.0.0.1:35029_fuhmz%2Fqu) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1793600 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1793606 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1793606 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1793607 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001/cores
[junit4] 2> 1793640 INFO (qtp1343053585-19696) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35029_fuhmz%252Fqu&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1793641 INFO (OverseerCollectionConfigSetProcessor-72074488990334980-127.0.0.1:35485_fuhmz%2Fqu-n_0000000000) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1793642 INFO (OverseerThreadFactory-7200-thread-4-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:35029_fuhmz%2Fqu for creating new replica
[junit4] 2> 1793650 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1793650 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1794697 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1794707 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 1795162 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1795170 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 1795170 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1795171 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1795171 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 1795173 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1795189 WARN (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1795217 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1795217 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1795218 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1795218 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1795219 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1436976361, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1795219 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e921231[collection1_shard1_replica_t43] main]
[junit4] 2> 1795220 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1795221 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1795221 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1795222 INFO (searcherExecutor-7225-thread-1-processing-n:127.0.0.1:35029_fuhmz%2Fqu x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@7e921231[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1795222 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593961554617827328
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35029/fuhmz/qu/collection1_shard1_replica_t43/
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:35029/fuhmz/qu/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1795226 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 1795228 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35029/fuhmz/qu/collection1_shard1_replica_t43/ shard1
[junit4] 2> 1795378 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1795380 INFO (qtp1343053585-19722) [n:127.0.0.1:35029_fuhmz%2Fqu c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1730
[junit4] 2> 1795381 INFO (qtp1343053585-19696) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35029_fuhmz%252Fqu&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1741
[junit4] 2> 1795450 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001 of type PULL
[junit4] 2> 1795451 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1795452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1795452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1795452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1795452 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53566a39{/fuhmz/qu,null,AVAILABLE}
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@50fd64a7{HTTP/1.1,[http/1.1]}{127.0.0.1:40845}
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.Server Started @1796849ms
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/tempDir-001/jetty3, replicaType=PULL, solrconfig=solrconfig.xml, hostContext=/fuhmz/qu, hostPort=40845, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001/cores}
[junit4] 2> 1795453 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1795453 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T23:36:36.209Z
[junit4] 2> 1795455 INFO (zkConnectionManagerCallback-3224-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1795455 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1795455 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001/solr.xml
[junit4] 2> 1795458 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1795458 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1795458 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1795462 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38413/solr
[junit4] 2> 1795462 INFO (zkConnectionManagerCallback-3228-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1795463 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1000f5da9a3000e, likely client has closed socket
[junit4] 2> 1795464 INFO (zkConnectionManagerCallback-3230-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1795466 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1795467 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1795468 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40845_fuhmz%2Fqu
[junit4] 2> 1795468 INFO (zkCallback-3201-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1795468 INFO (zkCallback-3209-thread-1-processing-n:127.0.0.1:36477_fuhmz%2Fqu) [n:127.0.0.1:36477_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1795468 INFO (zkCallback-3191-thread-2-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1795468 INFO (zkCallback-3219-thread-1-processing-n:127.0.0.1:35029_fuhmz%2Fqu) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1795469 INFO (zkCallback-3229-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1795503 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1795509 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1795509 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1795511 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001/cores
[junit4] 2> 1795538 INFO (qtp1343053585-19700) [n:127.0.0.1:35029_fuhmz%2Fqu ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40845_fuhmz%252Fqu&action=ADDREPLICA&collection=collection1&shard=shard2&type=PULL&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1795540 INFO (OverseerCollectionConfigSetProcessor-72074488990334980-127.0.0.1:35485_fuhmz%2Fqu-n_0000000000) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1795540 INFO (OverseerThreadFactory-7200-thread-5-processing-n:127.0.0.1:35485_fuhmz%2Fqu) [n:127.0.0.1:35485_fuhmz%2Fqu ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:40845_fuhmz%2Fqu for creating new replica
[junit4] 2> 1795544 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_p45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1795544 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1796555 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1796563 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.s.IndexSchema [collection1_shard2_replica_p45] Schema name=test
[junit4] 2> 1796623 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1796631 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_p45' using configuration from collection collection1, trusted=true
[junit4] 2> 1796632 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_p45' (registry 'solr.core.collection1.shard2.replica_p45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@396b77d6
[junit4] 2> 1796632 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1796632 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.SolrCore [[collection1_shard2_replica_p45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001/cores/collection1_shard2_replica_p45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-001/shard-3-001/cores/collection1_shard2_replica_p45/data/]
[junit4] 2> 1796635 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1796654 WARN (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1796679 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1796679 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1796680 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1436976361, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1796680 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.s.SolrIndexSearcher Opening [Searcher@393c5c6[collection1_shard2_replica_p45] main]
[junit4] 2> 1796681 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1796681 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1796682 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1796683 INFO (searcherExecutor-7236-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu x:collection1_shard2_replica_p45 s:shard2 c:collection1) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.SolrCore [collection1_shard2_replica_p45] Registered new searcher Searcher@393c5c6[collection1_shard2_replica_p45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1796683 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.ZkController collection1_shard2_replica_p45 starting background replication from leader
[junit4] 2> 1796683 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 0:0:7
[junit4] 2> 1796684 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 7000ms
[junit4] 2> 1796684 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1796685 INFO (qtp1856589561-19731) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 x:collection1_shard2_replica_p45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_p45
[junit4] 2> 1796685 INFO (updateExecutor-3225-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu x:collection1_shard2_replica_p45 s:shard2 c:collection1) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1796685 INFO (recoveryExecutor-3226-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu x:collection1_shard2_replica_p45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1796685 INFO (recoveryExecutor-3226-thread-1-processing-n:127.0.0.1:40845_fuhmz%2Fqu x:collection1_shard2_replica_p45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40845_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_p45] as recovering, leader is [http://127.0.0.1:36477/fuhmz/qu/collection1_shard2_r
[...truncated too long message...]
etty / com.codahale.metrics.MetricRegistry@16385875
[junit4] 2> 64955 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45451_fuhmz%2Fqu
[junit4] 2> 64955 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 64956 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:45451_fuhmz%2Fqu) [n:127.0.0.1:45451_fuhmz%2Fqu ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 64956 INFO (coreCloseExecutor-353-thread-1) [n:127.0.0.1:45451_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.c.SolrCore [collection1_shard2_replica_p45] CLOSING SolrCore org.apache.solr.core.SolrCore@44fe4cf1
[junit4] 2> 64956 INFO (coreCloseExecutor-353-thread-1) [n:127.0.0.1:45451_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_p45, tag=1157516529
[junit4] 2> 64956 INFO (coreCloseExecutor-353-thread-1) [n:127.0.0.1:45451_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fa6602e: rootName = null, domain = solr.core.collection1.shard2.replica_p45, service url = null, agent id = null] for registry solr.core.collection1.shard2.replica_p45 / com.codahale.metrics.MetricRegistry@3f9fe44f
[junit4] 2> 64962 INFO (coreCloseExecutor-353-thread-1) [n:127.0.0.1:45451_fuhmz%2Fqu c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_p45] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=1157516529
[junit4] 2> 64964 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.Overseer Overseer (id=72074625229324324-127.0.0.1:45451_fuhmz%2Fqu-n_0000000010) closing
[junit4] 2> 64964 INFO (OverseerStateUpdate-72074625229324324-127.0.0.1:45451_fuhmz%2Fqu-n_0000000010) [n:127.0.0.1:45451_fuhmz%2Fqu ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45451_fuhmz%2Fqu
[junit4] 2> 64964 WARN (OverseerAutoScalingTriggerThread-72074625229324324-127.0.0.1:45451_fuhmz%2Fqu-n_0000000010) [n:127.0.0.1:45451_fuhmz%2Fqu ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 64966 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@2a14caf2{HTTP/1.1,[http/1.1]}{127.0.0.1:45451}
[junit4] 2> 64967 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@224575da{/fuhmz/qu,null,UNAVAILABLE}
[junit4] 2> 64967 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 64967 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 41589
[junit4] 2> 64967 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 42831
[junit4] 2> 64967 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 39091
[junit4] 2> 64967 ERROR (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 64968 INFO (TEST-ChaosMonkeySafeLeaderWithPullReplicasTest.test-seed#[25C957257CBB2CC0]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38133 38133
[junit4] 2> 72252 INFO (Thread-107) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38133 38133
[junit4] 2> 72253 WARN (Thread-107) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/aliases.json
[junit4] 2> 12 /solr/collections/collection1/terms/shard2
[junit4] 2> 11 /solr/security.json
[junit4] 2> 11 /solr/configs/conf1
[junit4] 2> 10 /solr/collections/collection1/state.json
[junit4] 2> 10 /solr/collections/collection1/terms/shard1
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/clusterprops.json
[junit4] 2> 13 /solr/clusterstate.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 3 /solr/overseer_elect/election/72074625229324300-127.0.0.1:43695_fuhmz%2Fqu-n_0000000002
[junit4] 2> 3 /solr/overseer_elect/election/72074625229324303-127.0.0.1:45451_fuhmz%2Fqu-n_0000000003
[junit4] 2> 2 /solr/overseer_elect/election/72074625229324312-127.0.0.1:39091_fuhmz%2Fqu-n_0000000006
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 13 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest -Dtests.method=test -Dtests.seed=25C957257CBB2CC0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=ar-YE -Dtests.timezone=CNT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 34.5s J2 | ChaosMonkeySafeLeaderWithPullReplicasTest.test <<<
[junit4] > Throwable #1: java.lang.NumberFormatException: null
[junit4] > at __randomizedtesting.SeedInfo.seed([25C957257CBB2CC0:AD9D68FFD2474138]:0)
[junit4] > at java.lang.Long.parseLong(Long.java:552)
[junit4] > at java.lang.Long.parseLong(Long.java:631)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForReplicationFromReplicas(AbstractFullDistribZkTestBase.java:2134)
[junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:210)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest_25C957257CBB2CC0-002
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=15138, maxDocsPerChunk=719, blockSize=237), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=15138, blockSize=237)), sim=RandomSimilarity(queryNorm=false): {}, locale=ar-YE, timezone=CNT
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=294126656,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [ChaosMonkeySafeLeaderWithPullReplicasTest, ChaosMonkeySafeLeaderWithPullReplicasTest]
[junit4] Completed [4/5 (3!)] on J2 in 34.48s, 1 test, 1 error <<< FAILURES!
[...truncated 17 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 5 tests, 3 errors [seed: 25C957257CBB2CC0]
Total time: 1 minute 17 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 3/5 failed: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=1a3468b87282a97222243b7176d9eaeb603e4968, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1461
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.4) - Build # 1461 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1461/
Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseParallelGC
6 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:FDEFD0247A06A813]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:FDEFD0247A06A813]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:FDEFD0247A06A813]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:FDEFD0247A06A813]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:A741DAF82D9C35D2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([6EF4985624FBF327:A741DAF82D9C35D2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12310 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 30781 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/init-core-data-001
[junit4] 2> 30782 WARN (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=26 numCloses=26
[junit4] 2> 30782 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 30783 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 30785 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001
[junit4] 2> 30785 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 30788 INFO (Thread-52) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 30788 INFO (Thread-52) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 30801 ERROR (Thread-52) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 30888 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36353
[junit4] 2> 30892 INFO (zkConnectionManagerCallback-117-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30903 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 30903 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 30924 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 30924 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35c9debb{/solr,null,AVAILABLE}
[junit4] 2> 30925 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47cc8eb2{/solr,null,AVAILABLE}
[junit4] 2> 30927 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@45ed81fd{SSL,[ssl, http/1.1]}{127.0.0.1:40657}
[junit4] 2> 30927 INFO (jetty-launcher-114-thread-2) [ ] o.e.j.s.Server Started @32545ms
[junit4] 2> 30927 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40657}
[junit4] 2> 30928 ERROR (jetty-launcher-114-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T16:36:16.833396Z
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@193bcb9f{SSL,[ssl, http/1.1]}{127.0.0.1:38047}
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-1) [ ] o.e.j.s.Server Started @32546ms
[junit4] 2> 30928 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38047}
[junit4] 2> 30929 ERROR (jetty-launcher-114-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 30930 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 30930 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 30930 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 30930 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T16:36:16.835437Z
[junit4] 2> 30949 INFO (zkConnectionManagerCallback-119-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30950 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 30968 INFO (zkConnectionManagerCallback-121-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30973 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 31001 INFO (jetty-launcher-114-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36353/solr
[junit4] 2> 31009 INFO (jetty-launcher-114-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36353/solr
[junit4] 2> 31020 INFO (zkConnectionManagerCallback-125-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31025 INFO (zkConnectionManagerCallback-129-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31048 INFO (zkConnectionManagerCallback-131-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31055 INFO (zkConnectionManagerCallback-133-thread-1-processing-n:127.0.0.1:38047_solr) [n:127.0.0.1:38047_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31131 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 31131 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38047_solr
[junit4] 2> 31132 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.Overseer Overseer (id=72072836649320454-127.0.0.1:38047_solr-n_0000000000) starting
[junit4] 2> 31136 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 31137 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40657_solr
[junit4] 2> 31157 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 31171 INFO (zkCallback-132-thread-1-processing-n:127.0.0.1:38047_solr) [n:127.0.0.1:38047_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 31180 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38047_solr
[junit4] 2> 31187 INFO (OverseerStateUpdate-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 31192 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 31194 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 31195 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 31196 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:38047_solr, 127.0.0.1:40657_solr]
[junit4] 2> 31196 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 31196 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 31208 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 31209 DEBUG (ScheduledTrigger-106-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 31221 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 31289 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40657.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31291 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38047.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31302 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40657.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31303 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40657.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31303 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38047.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31303 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38047.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 31304 INFO (jetty-launcher-114-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001/node2/.
[junit4] 2> 31305 INFO (jetty-launcher-114-thread-1) [n:127.0.0.1:38047_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001/node1/.
[junit4] 2> 31368 INFO (zkConnectionManagerCallback-139-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31377 INFO (zkConnectionManagerCallback-143-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 31378 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 31379 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36353/solr ready
[junit4] 2> 31389 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
[junit4] 2> 31403 INFO (qtp768046747-369) [n:127.0.0.1:38047_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 31411 INFO (qtp768046747-369) [n:127.0.0.1:38047_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 31412 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 31414 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 31414 DEBUG (zkCallback-132-thread-1-processing-n:127.0.0.1:38047_solr) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 31414 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 31414 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 31415 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 31416 DEBUG (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 31417 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 31421 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@193bcb9f{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 31421 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1030196737
[junit4] 2> 31421 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 31422 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e7a4b5a: rootName = solr_38047, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@7c13ce5
[junit4] 2> 31427 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 31427 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7a243b6f: rootName = solr_38047, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4be2c73d
[junit4] 2> 31431 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 31431 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@830254f: rootName = solr_38047, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3ee0deea
[junit4] 2> 31432 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38047_solr
[junit4] 2> 31433 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 31433 INFO (zkCallback-132-thread-1-processing-n:127.0.0.1:38047_solr) [n:127.0.0.1:38047_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 31433 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 31433 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 31441 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 31441 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.Overseer Overseer (id=72072836649320454-127.0.0.1:38047_solr-n_0000000000) closing
[junit4] 2> 31441 INFO (OverseerStateUpdate-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38047_solr
[junit4] 2> 31461 WARN (OverseerAutoScalingTriggerThread-72072836649320454-127.0.0.1:38047_solr-n_0000000000) [n:127.0.0.1:38047_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 31461 DEBUG (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 31462 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 31462 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40657_solr
[junit4] 2> 31463 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.Overseer Overseer (id=72072836649320453-127.0.0.1:40657_solr-n_0000000001) starting
[junit4] 2> 31465 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@47cc8eb2{/solr,null,UNAVAILABLE}
[junit4] 2> 31465 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 31470 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 31471 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 31471 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40657_solr]
[junit4] 2> 31471 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
[junit4] 2> 31471 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 31474 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 31474 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 31474 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 32475 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 33475 DEBUG (ScheduledTrigger-115-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 34476 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 35476 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 36467 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 36468 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 36468 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 36468 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 36468 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9429251{/solr,null,AVAILABLE}
[junit4] 2> 36469 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@72634ce3{SSL,[ssl, http/1.1]}{127.0.0.1:36061}
[junit4] 2> 36469 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server Started @38087ms
[junit4] 2> 36469 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36061}
[junit4] 2> 36469 ERROR (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 36469 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 36469 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 36470 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 36470 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T16:36:22.375028Z
[junit4] 2> 36471 INFO (zkConnectionManagerCallback-146-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 36472 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 36476 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 36488 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36353/solr
[junit4] 2> 36493 INFO (zkConnectionManagerCallback-150-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 36495 INFO (zkConnectionManagerCallback-152-thread-1-processing-n:127.0.0.1:36061_solr) [n:127.0.0.1:36061_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 36499 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 36500 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 36501 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36061_solr
[junit4] 2> 36504 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 36504 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 36504 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 36521 INFO (zkCallback-151-thread-1-processing-n:127.0.0.1:36061_solr) [n:127.0.0.1:36061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 36540 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36061.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 36550 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36061.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 36550 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36061.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 36552 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:36061_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001/node3/.
[junit4] 2> 36667 INFO (qtp287097331-434) [n:127.0.0.1:36061_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 36676 INFO (qtp287097331-434) [n:127.0.0.1:36061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 36709 INFO (qtp287097331-428) [n:127.0.0.1:36061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=7
[junit4] 2> 36722 INFO (qtp394064635-365) [n:127.0.0.1:40657_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 36723 DEBUG (qtp287097331-432) [n:127.0.0.1:36061_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 36724 INFO (qtp287097331-432) [n:127.0.0.1:36061_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=41
[junit4] 2> 36724 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 36725 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36061_solr, 127.0.0.1:40657_solr]
[junit4] 2> 36725 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:36061_solr, 127.0.0.1:40657_solr]
[junit4] 2> 36725 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 36726 INFO (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 36726 DEBUG (ScheduledTrigger-115-thread-3) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
[junit4] 2> 36727 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 36727 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@72634ce3{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 36727 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 36727 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1573086173
[junit4] 2> 36728 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 36728 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6eccc1b6: rootName = solr_36061, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@488c8d15
[junit4] 2> 36736 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 36736 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@660d50a8: rootName = solr_36061, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4be2c73d
[junit4] 2> 36741 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 36741 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2dcd3ed0: rootName = solr_36061, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3ee0deea
[junit4] 2> 36742 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36061_solr
[junit4] 2> 36743 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 36743 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 36743 INFO (zkCallback-151-thread-1-processing-n:127.0.0.1:36061_solr) [n:127.0.0.1:36061_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 36743 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 36743 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 36743 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 36750 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9429251{/solr,null,UNAVAILABLE}
[junit4] 2> 36750 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 37476 DEBUG (ScheduledTrigger-115-thread-2) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 37728 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 37728 DEBUG (ScheduledTrigger-115-thread-1) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:36061_solr
[junit4] 2> 38477 DEBUG (ScheduledTrigger-115-thread-3) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 38672 INFO (OverseerCollectionConfigSetProcessor-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 38729 DEBUG (ScheduledTrigger-115-thread-4) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 1
[junit4] 2> 38729 DEBUG (ScheduledTrigger-115-thread-4) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:36061_solr]
[junit4] 2> 38730 DEBUG (ScheduledTrigger-115-thread-4) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"d38a3fb16129T4ksjixhsfzr0r8y12uwcd639v",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":232590727536937,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[232590727536937],
[junit4] 2> "nodeNames":["127.0.0.1:36061_solr"]}}
[junit4] 2> 38730 DEBUG (ScheduledTrigger-115-thread-4) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_lost_trigger]
[junit4] 2> 38731 INFO (ScheduledTrigger-115-thread-4) [n:127.0.0.1:40657_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 38732 DEBUG (AutoscalingActionExecutor-116-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"d38a3fb16129T4ksjixhsfzr0r8y12uwcd639v",
[junit4] 2> "source":"node_lost_trigger",
[junit4] 2> "eventTime":232590727536937,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[232590727536937],
[junit4] 2> "_enqueue_time_":232591730023786,
[junit4] 2> "nodeNames":["127.0.0.1:36061_solr"]}}
[junit4] 2> 38736 DEBUG (AutoscalingActionExecutor-116-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
[junit4] 2> 38736 DEBUG (AutoscalingActionExecutor-116-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 5000ms
[junit4] 2> 38736 DEBUG (AutoscalingActionExecutor-116-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 3 ms for event id=d38a3fb16129T4ksjixhsfzr0r8y12uwcd639v
[junit4] 2> 38742 INFO (qtp394064635-355) [n:127.0.0.1:40657_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 38743 DEBUG (qtp394064635-363) [n:127.0.0.1:40657_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 38743 INFO (qtp394064635-363) [n:127.0.0.1:40657_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 38743 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 38744 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40657_solr]
[junit4] 2> 38744 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:40657_solr]
[junit4] 2> 38744 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 38744 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 38744 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 40744 INFO (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
[junit4] IGNOR/A 0.00s J0 | TriggerIntegrationTest.testSearchRate
[junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
[junit4] 2> 40751 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
[junit4] 2> 40752 INFO (qtp394064635-365) [n:127.0.0.1:40657_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 40756 INFO (qtp394064635-365) [n:127.0.0.1:40657_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 40757 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 40758 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_trigger
[junit4] 2> 40758 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 6
[junit4] 2> 40759 DEBUG (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 40759 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 40759 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 40759 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 40759 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 40759 DEBUG (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 40761 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@45ed81fd{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 40761 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=144875590
[junit4] 2> 40761 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 40761 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35267486: rootName = solr_40657, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@358ea6ca
[junit4] 2> 40768 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 40768 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@deaf305: rootName = solr_40657, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4be2c73d
[junit4] 2> 40772 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 40773 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@63b44882: rootName = solr_40657, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@3ee0deea
[junit4] 2> 40774 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40657_solr
[junit4] 2> 40774 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 40774 INFO (zkCallback-130-thread-1-processing-n:127.0.0.1:40657_solr) [n:127.0.0.1:40657_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 40774 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 40774 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 40775 INFO (zkCallback-142-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 40775 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 40775 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.Overseer Overseer (id=72072836649320453-127.0.0.1:40657_solr-n_0000000001) closing
[junit4] 2> 40775 INFO (OverseerStateUpdate-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40657_solr
[junit4] 2> 40775 DEBUG (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 40775 WARN (OverseerAutoScalingTriggerThread-72072836649320453-127.0.0.1:40657_solr-n_0000000001) [n:127.0.0.1:40657_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 40776 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@35c9debb{/solr,null,UNAVAILABLE}
[junit4] 2> 40776 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 45779 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 45779 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 45779 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 45779 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 45780 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ae7912f{/solr,null,AVAILABLE}
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5a05f6d6{SSL,[ssl, http/1.1]}{127.0.0.1:44595}
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server Started @47398ms
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44595}
[junit4] 2> 45781 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 45781 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T16:36:31.686671Z
[junit4] 2> 45783 INFO (zkConnectionManagerCallback-157-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45783 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 45795 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36353/solr
[junit4] 2> 45796 INFO (zkConnectionManagerCallback-161-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45799 INFO (zkConnectionManagerCallback-163-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45802 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 45803 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44595_solr
[junit4] 2> 45803 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.c.Overseer Overseer (id=72072836649320462-127.0.0.1:44595_solr-n_0000000003) starting
[junit4] 2> 45809 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 45809 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44595_solr
[junit4] 2> 45809 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 45809 INFO (zkCallback-142-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 45809 INFO (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 45810 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 45812 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 45813 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44595_solr]
[junit4] 2> 45813 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion -1
[junit4] 2> 45813 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 45814 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 45814 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 45814 DEBUG (ScheduledTrigger-131-thread-1) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 45840 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44595.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45847 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44595.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45848 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44595.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45849 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:44595_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001/node4/.
[junit4] 2> 45867 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 45874 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 45874 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 45874 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 45874 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14ebdd5b{/solr,null,AVAILABLE}
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@14bc218a{SSL,[ssl, http/1.1]}{127.0.0.1:43373}
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.e.j.s.Server Started @47493ms
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43373}
[junit4] 2> 45875 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 45875 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T16:36:31.780962Z
[junit4] 2> 45877 INFO (zkConnectionManagerCallback-167-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45878 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 45885 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36353/solr
[junit4] 2> 45886 INFO (zkConnectionManagerCallback-171-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45889 INFO (zkConnectionManagerCallback-173-thread-1-processing-n:127.0.0.1:43373_solr) [n:127.0.0.1:43373_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 45892 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 45893 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 45894 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43373_solr
[junit4] 2> 45894 INFO (zkCallback-142-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 45894 INFO (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 45894 INFO (zkCallback-142-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 45894 INFO (zkCallback-142-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 45897 INFO (zkCallback-172-thread-1-processing-n:127.0.0.1:43373_solr) [n:127.0.0.1:43373_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 45930 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43373.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45936 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43373.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45936 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43373.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3db28533
[junit4] 2> 45937 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6EF4985624FBF327]) [n:127.0.0.1:43373_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-001/tempDir-001/node5/.
[junit4] 2> 45984 INFO (qtp1238853318-500) [n:127.0.0.1:43373_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 45988 INFO (qtp1131454299-465) [n:127.0.0.1:44595_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 45989 DEBUG (qtp1131454299-471) [n:127.0.0.1:44595_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 45989 INFO (qtp1131454299-471) [n:127.0.0.1:44595_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=17
[junit4] 2> 45990 DEBUG (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 45990 DEBUG (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:43373_solr, 127.0.0.1:44595_solr]
[junit4] 2> 45991 DEBUG (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:43373_solr, 127.0.0.1:44595_solr]
[junit4] 2> 45991 DEBUG (zkCallback-162-thread-1-processing-n:127.0.0.1:44595_solr) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 45991 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 45993 INFO (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 45993 DEBUG (OverseerAutoScalingTriggerThread-72072836649320462-127.0.0.1:44595_solr-n_0000000003) [n:127.0.0.1:44595_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 45993 DEBUG (ScheduledTrigger-131-thread-1) [n:127.0.0.1:44595_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAdded
[...truncated too long message...]
at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4724)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 572466 INFO (jetty-closer-317-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@53cc0b29{/solr,null,UNAVAILABLE}
[junit4] 2> 572466 INFO (jetty-closer-317-thread-4) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 572468 WARN (zkCallback-596-thread-2-processing-n:127.0.0.1:39693_solr) [n:127.0.0.1:39693_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:45255_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:45255_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4724)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 572469 INFO (jetty-closer-317-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@56882d86{/solr,null,UNAVAILABLE}
[junit4] 2> 572469 INFO (jetty-closer-317-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 572472 INFO (jetty-closer-317-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6daee875{/solr,null,UNAVAILABLE}
[junit4] 2> 572472 INFO (jetty-closer-317-thread-5) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 572472 ERROR (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 572472 INFO (SUITE-TriggerIntegrationTest-seed#[6EF4985624FBF327]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43105 43105
[junit4] 2> 578451 INFO (Thread-326) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43105 43105
[junit4] 2> 578452 WARN (Thread-326) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 44 /solr/aliases.json
[junit4] 2> 34 /solr/collections/collection1/terms/shard1
[junit4] 2> 28 /solr/security.json
[junit4] 2> 13 /solr/collections/testScheduledTrigger/terms/shard1
[junit4] 2> 11 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 9 /solr/configs/conf
[junit4] 2> 8 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2> 3 /solr/configs/testScheduledTrigger.AUTOCREATED/managed-schema
[junit4] 2> 3 /solr/configs/testScheduledTrigger.AUTOCREATED
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 51 /solr/collections/collection1/state.json
[junit4] 2> 44 /solr/clusterprops.json
[junit4] 2> 44 /solr/clusterstate.json
[junit4] 2> 36 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 21 /solr/autoscaling.json
[junit4] 2> 19 /solr/collections/testScheduledTrigger/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72073051202060322-127.0.0.1:40637_solr-n_0000000009
[junit4] 2> 2 /solr/overseer_elect/election/72073051202060368-127.0.0.1:39693_solr-n_0000000024
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72073051202060311-core_node6-n_0000000002
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72073051202060305-core_node3-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72073051202060356-127.0.0.1:42277_solr-n_0000000020
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 446 /solr/live_nodes
[junit4] 2> 69 /solr/collections
[junit4] 2> 21 /solr/overseer/queue-work
[junit4] 2> 21 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 21 /solr/overseer/queue
[junit4] 2> 21 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6EF4985624FBF327-002
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval), x_s=FST50}, docValues:{}, maxPointsInLeafNode=1183, maxMBSortInHeap=6.883798296595913, sim=RandomSimilarity(queryNorm=false): {}, locale=yue-HK, timezone=America/Rio_Branco
[junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=220250456,total=504365056
[junit4] 2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TriggerIntegrationTest]
[junit4] Completed [5/5 (5!)] on J1 in 284.78s, 15 tests, 2 failures <<< FAILURES!
[...truncated 17 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 75 tests, 7 failures [seed: 6EF4985624FBF327]
Total time: 9 minutes 41 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 5/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=e0cfb9686bb458ab4be774dbef553493ee4ab9f2, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1459
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+43) - Build #
1460 - Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1460/
Java: 64bit/jdk-10-ea+43 -XX:-UseCompressedOops -XX:+UseG1GC
All tests passed
Build Log:
[...truncated 14859 lines...]
[junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20180303_111308_90415429905914053819534.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/heapdumps/java_pid15213.hprof ...
[junit4] Heap dump file created [328897384 bytes in 0.521 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 8721 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:618: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:570: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid15213.hprof
Total time: 78 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_162) - Build # 1459
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1459/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseParallelGC
8 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:616862234BA53828]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.junit.Assert.assertNotNull(Assert.java:537)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testScheduledTrigger(TriggerIntegrationTest.java:1683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:3BC668FF1C3FA5E9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at __randomizedtesting.SeedInfo.seed([F2732A511558631C:3BC668FF1C3FA5E9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:729)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 14215 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 2655095 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/init-core-data-001
[junit4] 2> 2655095 WARN (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=8 numCloses=8
[junit4] 2> 2655096 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2655097 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2655099 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/tempDir-001
[junit4] 2> 2655099 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2655099 INFO (Thread-5050) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2655099 INFO (Thread-5050) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2655101 ERROR (Thread-5050) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2655199 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:32801
[junit4] 2> 2655201 INFO (zkConnectionManagerCallback-10683-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655205 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:57:37+06:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2655205 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:57:37+06:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2655208 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2655209 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1742ffc{/solr,null,AVAILABLE}
[junit4] 2> 2655209 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1959cea{/solr,null,AVAILABLE}
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9d9ad4{SSL,[ssl, http/1.1]}{127.0.0.1:44529}
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1438115{SSL,[ssl, http/1.1]}{127.0.0.1:39177}
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.e.j.s.Server Started @2656307ms
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.e.j.s.Server Started @2656307ms
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44529}
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39177}
[junit4] 2> 2655211 ERROR (jetty-launcher-10680-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2655211 ERROR (jetty-launcher-10680-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T05:22:34.001Z
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2655211 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T05:22:34.001Z
[junit4] 2> 2655213 INFO (zkConnectionManagerCallback-10685-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655213 INFO (zkConnectionManagerCallback-10687-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655213 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2655213 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2655224 INFO (jetty-launcher-10680-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32801/solr
[junit4] 2> 2655225 INFO (jetty-launcher-10680-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32801/solr
[junit4] 2> 2655225 INFO (zkConnectionManagerCallback-10693-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655226 INFO (zkConnectionManagerCallback-10695-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655227 INFO (zkConnectionManagerCallback-10697-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655227 INFO (zkConnectionManagerCallback-10699-thread-1-processing-n:127.0.0.1:44529_solr) [n:127.0.0.1:44529_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655302 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2655302 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2655302 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44529_solr
[junit4] 2> 2655302 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39177_solr
[junit4] 2> 2655303 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.c.Overseer Overseer (id=72070187500240902-127.0.0.1:44529_solr-n_0000000000) starting
[junit4] 2> 2655306 INFO (zkCallback-10698-thread-1-processing-n:127.0.0.1:44529_solr) [n:127.0.0.1:44529_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2655310 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2655340 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 2655343 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44529_solr
[junit4] 2> 2655352 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2655359 INFO (zkCallback-10698-thread-2-processing-n:127.0.0.1:44529_solr) [n:127.0.0.1:44529_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2655364 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2655364 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44529_solr, 127.0.0.1:39177_solr]
[junit4] 2> 2655365 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 2655365 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2655377 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2655377 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2655377 DEBUG (ScheduledTrigger-10303-thread-1) [n:127.0.0.1:44529_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2655488 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39177.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655490 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44529.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655500 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39177.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655500 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39177.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655508 INFO (jetty-launcher-10680-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/tempDir-001/node1/.
[junit4] 2> 2655512 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44529.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655513 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44529.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2655515 INFO (jetty-launcher-10680-thread-2) [n:127.0.0.1:44529_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/tempDir-001/node2/.
[junit4] 2> 2655571 INFO (zkConnectionManagerCallback-10705-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655574 INFO (zkConnectionManagerCallback-10709-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2655575 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2655576 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:32801/solr ready
[junit4] 2> 2655596 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSetProperties
[junit4] 2> 2655672 INFO (qtp805062-31133) [n:127.0.0.1:44529_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2655680 INFO (qtp805062-31133) [n:127.0.0.1:44529_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 2655682 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 2655684 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 2655684 DEBUG (zkCallback-10698-thread-2-processing-n:127.0.0.1:44529_solr) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 2655684 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 2655684 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2655684 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2655684 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2655684 DEBUG (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 2655686 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@9d9ad4{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2655686 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=32779311
[junit4] 2> 2655686 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2655687 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d6729e: rootName = solr_44529, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1b7cb6d
[junit4] 2> 2655696 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2655696 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e4ef49: rootName = solr_44529, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1d03103
[junit4] 2> 2655704 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2655704 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@895db9: rootName = solr_44529, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1688949
[junit4] 2> 2655705 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44529_solr
[junit4] 2> 2655706 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2655706 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2655706 INFO (zkCallback-10698-thread-2-processing-n:127.0.0.1:44529_solr) [n:127.0.0.1:44529_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2655706 INFO (zkCallback-10708-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2655706 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2655706 INFO (zkCallback-10708-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2655706 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.Overseer Overseer (id=72070187500240902-127.0.0.1:44529_solr-n_0000000000) closing
[junit4] 2> 2655707 INFO (OverseerStateUpdate-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44529_solr
[junit4] 2> 2655707 WARN (OverseerAutoScalingTriggerThread-72070187500240902-127.0.0.1:44529_solr-n_0000000000) [n:127.0.0.1:44529_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2655707 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 2655708 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1742ffc{/solr,null,UNAVAILABLE}
[junit4] 2> 2655708 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2655708 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39177_solr
[junit4] 2> 2655709 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.Overseer Overseer (id=72070187500240901-127.0.0.1:39177_solr-n_0000000001) starting
[junit4] 2> 2655711 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 2655712 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 2655712 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:39177_solr]
[junit4] 2> 2655712 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
[junit4] 2> 2655712 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 2655713 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2655713 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 2655713 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2656714 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2657715 DEBUG (ScheduledTrigger-10312-thread-2) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2658715 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2659715 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2660710 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:57:37+06:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2660711 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2660711 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2660711 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2660711 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b9f97a{/solr,null,AVAILABLE}
[junit4] 2> 2660712 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3151a4{SSL,[ssl, http/1.1]}{127.0.0.1:34211}
[junit4] 2> 2660712 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.e.j.s.Server Started @2661809ms
[junit4] 2> 2660712 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34211}
[junit4] 2> 2660713 ERROR (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2660713 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2660713 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2660713 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2660713 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T05:22:39.503Z
[junit4] 2> 2660715 INFO (zkConnectionManagerCallback-10712-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2660716 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2660716 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2660729 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32801/solr
[junit4] 2> 2660730 INFO (zkConnectionManagerCallback-10716-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2660733 INFO (zkConnectionManagerCallback-10718-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2660737 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2660738 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2660740 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34211_solr
[junit4] 2> 2660741 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2660741 INFO (zkCallback-10708-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2660741 INFO (zkCallback-10708-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2660743 INFO (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2660843 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34211.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2660853 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34211.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2660854 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34211.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2660855 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [n:127.0.0.1:34211_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/tempDir-001/node3/.
[junit4] 2> 2661716 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2661889 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 1 to: 4
[junit4] 2> 2662717 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2663717 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2664717 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2665718 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2665891 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerScheduleDelaySeconds from: 4 to: 1
[junit4] 2> 2666718 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2667718 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2668719 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2669719 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2670719 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2671720 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2672720 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2673721 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2674721 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2675721 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2675898 DEBUG (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerCorePoolSize from: 4 to: 6
[junit4] 2> 2676721 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2677722 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2678722 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2679722 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2680722 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2681723 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2682723 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2683723 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2684723 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2685724 DEBUG (ScheduledTrigger-10312-thread-1) [n:127.0.0.1:39177_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 2685908 INFO (TEST-TriggerIntegrationTest.testSetProperties-seed#[F2732A511558631C]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSetProperties
[junit4] 2> 2685922 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
[junit4] 2> 2686007 INFO (qtp3975401-31201) [n:127.0.0.1:34211_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2686012 INFO (qtp3975401-31201) [n:127.0.0.1:34211_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 2686013 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 2686014 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 4
[junit4] 2> 2686014 DEBUG (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 2686014 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 2686014 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2686015 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2686015 DEBUG (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 2686015 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2686016 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1438115{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2686016 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=20289239
[junit4] 2> 2686016 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2686016 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@611e8c: rootName = solr_39177, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1a8133d
[junit4] 2> 2686027 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2686027 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@8e486: rootName = solr_39177, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1d03103
[junit4] 2> 2686035 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2686036 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15122d5: rootName = solr_39177, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1688949
[junit4] 2> 2686037 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39177_solr
[junit4] 2> 2686038 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2686038 INFO (zkCallback-10708-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2686038 INFO (zkCallback-10696-thread-1-processing-n:127.0.0.1:39177_solr) [n:127.0.0.1:39177_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2686038 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2686038 INFO (zkCallback-10708-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2686038 INFO (zkCallback-10708-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2686038 INFO (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2686038 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.Overseer Overseer (id=72070187500240901-127.0.0.1:39177_solr-n_0000000001) closing
[junit4] 2> 2686038 INFO (OverseerStateUpdate-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39177_solr
[junit4] 2> 2686038 WARN (OverseerAutoScalingTriggerThread-72070187500240901-127.0.0.1:39177_solr-n_0000000001) [n:127.0.0.1:39177_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2686039 DEBUG (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 2686039 INFO (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34211_solr
[junit4] 2> 2686039 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1959cea{/solr,null,UNAVAILABLE}
[junit4] 2> 2686040 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2686040 INFO (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.Overseer Overseer (id=72070187500240907-127.0.0.1:34211_solr-n_0000000002) starting
[junit4] 2> 2686043 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 2686044 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 2686044 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34211_solr]
[junit4] 2> 2686044 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion -1
[junit4] 2> 2686045 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 2686045 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2686046 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 2686046 DEBUG (ScheduledTrigger-10325-thread-1) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2687046 DEBUG (ScheduledTrigger-10325-thread-1) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2688047 DEBUG (ScheduledTrigger-10325-thread-2) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2689047 DEBUG (ScheduledTrigger-10325-thread-1) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2690047 DEBUG (ScheduledTrigger-10325-thread-1) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2691041 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:57:37+06:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2691042 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2691042 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2691042 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2691042 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b00953{/solr,null,AVAILABLE}
[junit4] 2> 2691043 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@756b80{SSL,[ssl, http/1.1]}{127.0.0.1:44393}
[junit4] 2> 2691043 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.Server Started @2692140ms
[junit4] 2> 2691043 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44393}
[junit4] 2> 2691044 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2691044 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2691044 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2691044 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2691044 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-03T05:23:09.834Z
[junit4] 2> 2691045 INFO (zkConnectionManagerCallback-10723-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2691046 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2691048 DEBUG (ScheduledTrigger-10325-thread-1) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 2691062 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:32801/solr
[junit4] 2> 2691064 INFO (zkConnectionManagerCallback-10727-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2691066 INFO (zkConnectionManagerCallback-10729-thread-1-processing-n:127.0.0.1:44393_solr) [n:127.0.0.1:44393_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2691077 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2691078 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2691079 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44393_solr
[junit4] 2> 2691080 INFO (zkCallback-10708-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2691080 INFO (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2691080 INFO (zkCallback-10708-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2691080 INFO (zkCallback-10728-thread-1-processing-n:127.0.0.1:44393_solr) [n:127.0.0.1:44393_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2691080 INFO (zkCallback-10708-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2691393 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44393.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2691404 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44393.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2691404 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44393.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@b42303
[junit4] 2> 2691406 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [n:127.0.0.1:44393_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-001/tempDir-001/node4/.
[junit4] 2> 2691443 INFO (qtp3975401-31197) [n:127.0.0.1:34211_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2691533 INFO (qtp14127872-31243) [n:127.0.0.1:44393_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 2691533 DEBUG (qtp3975401-31203) [n:127.0.0.1:34211_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2691534 INFO (qtp3975401-31203) [n:127.0.0.1:34211_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=95
[junit4] 2> 2691534 DEBUG (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 2691535 DEBUG (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34211_solr, 127.0.0.1:44393_solr]
[junit4] 2> 2691535 DEBUG (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:34211_solr, 127.0.0.1:44393_solr]
[junit4] 2> 2691535 DEBUG (zkCallback-10717-thread-1-processing-n:127.0.0.1:34211_solr) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 2691535 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 2691537 INFO (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2691538 DEBUG (OverseerAutoScalingTriggerThread-72070187500240907-127.0.0.1:34211_solr-n_0000000002) [n:127.0.0.1:34211_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 2691538 DEBUG (ScheduledTrigger-10325-thread-3) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 2691538 DEBUG (ScheduledTrigger-10325-thread-3) [n:127.0.0.1:34211_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 2691539 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T03:57:37+06:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2691539 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2691539 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2691539 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 2691540 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b6ead0{/solr,null,AVAILABLE}
[junit4] 2> 2691541 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15e41d{SSL,[ssl, http/1.1]}{127.0.0.1:42715}
[junit4] 2> 2691541 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.e.j.s.Server Started @2692637ms
[junit4] 2> 2691541 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42715}
[junit4] 2> 2691541 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2691541 INFO (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[F2732A511558631C]) [ ] o.a.s.s.SolrD
[...truncated too long message...]
SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 583504 WARN (zkCallback-568-thread-1-processing-n:127.0.0.1:44143_solr) [n:127.0.0.1:44143_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:44143_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:44143_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 583505 INFO (jetty-closer-298-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d50298{/solr,null,UNAVAILABLE}
[junit4] 2> 583505 INFO (jetty-closer-298-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 583506 INFO (jetty-closer-298-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@44b97{/solr,null,UNAVAILABLE}
[junit4] 2> 583506 INFO (jetty-closer-298-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 583506 ERROR (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 583506 INFO (SUITE-TriggerIntegrationTest-seed#[F2732A511558631C]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46049 46049
[junit4] 2> 585820 INFO (Thread-305) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46049 46049
[junit4] 2> 585821 WARN (Thread-305) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/aliases.json
[junit4] 2> 36 /solr/collections/collection1/terms/shard1
[junit4] 2> 26 /solr/security.json
[junit4] 2> 18 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 15 /solr/collections/testScheduledTrigger/terms/shard1
[junit4] 2> 9 /solr/configs/conf
[junit4] 2> 8 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2> 3 /solr/configs/testScheduledTrigger.AUTOCREATED/managed-schema
[junit4] 2> 3 /solr/configs/testScheduledTrigger.AUTOCREATED
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 60 /solr/collections/collection1/state.json
[junit4] 2> 46 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 42 /solr/clusterprops.json
[junit4] 2> 42 /solr/clusterstate.json
[junit4] 2> 21 /solr/autoscaling.json
[junit4] 2> 19 /solr/collections/testScheduledTrigger/state.json
[junit4] 2> 2 /solr/overseer_elect/election/72070289331585062-127.0.0.1:44617_solr-n_0000000011
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72070289331585044-core_node4-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/72070289331585094-127.0.0.1:38083_solr-n_0000000021
[junit4] 2> 2 /solr/collections/testMetricTrigger/leader_elect/shard1/election/72070289331585090-core_node5-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72070289331585080-127.0.0.1:41543_solr-n_0000000017
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 414 /solr/live_nodes
[junit4] 2> 93 /solr/collections
[junit4] 2> 21 /solr/overseer/queue-work
[junit4] 2> 21 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 21 /solr/overseer/queue
[junit4] 2> 21 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_F2732A511558631C-002
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=BlockTreeOrds(blocksize=128), x_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{_version_=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=393, maxMBSortInHeap=6.982885264996355, sim=RandomSimilarity(queryNorm=true): {}, locale=es-US, timezone=Asia/Kashgar
[junit4] 2> NOTE: Linux 4.13.0-36-generic i386/Oracle Corporation 1.8.0_162 (32-bit)/cpus=8,threads=1,free=105127048,total=214958080
[junit4] 2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TriggerIntegrationTest]
[junit4] Completed [5/5 (5!)] on J1 in 290.92s, 15 tests, 2 failures <<< FAILURES!
[...truncated 17 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1561: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1085: There were test failures: 5 suites, 75 tests, 7 failures [seed: F2732A511558631C]
Total time: 9 minutes 49 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 5/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=00a0e146be299be03e51356b511abf45a2ab326b, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #1458
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2