You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/03/12 00:15:06 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 4490
- Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4490/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
4 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
Error Message:
should be at least one inactive event
Stack Trace:
java.lang.AssertionError: should be at least one inactive event
at __randomizedtesting.SeedInfo.seed([45C8B56ADD3512BF:58E47518BC7635B4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:218)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
Error Message:
missing cleanup event
Stack Trace:
java.lang.AssertionError: missing cleanup event
at __randomizedtesting.SeedInfo.seed([45C8B56ADD3512BF:58E47518BC7635B4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:219)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
Error Message:
should be at least one inactive event
Stack Trace:
java.lang.AssertionError: should be at least one inactive event
at __randomizedtesting.SeedInfo.seed([45C8B56ADD3512BF:58E47518BC7635B4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:218)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
Error Message:
cleanup action didn't run
Stack Trace:
java.lang.AssertionError: cleanup action didn't run
at __randomizedtesting.SeedInfo.seed([45C8B56ADD3512BF:58E47518BC7635B4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12596 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest
[junit4] 2> 617577 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_45C8B56ADD3512BF-001/init-core-data-001
[junit4] 2> 617578 WARN (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
[junit4] 2> 617578 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 617583 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 617584 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_45C8B56ADD3512BF-001/tempDir-001
[junit4] 2> 617584 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 617585 INFO (Thread-1055) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 617585 INFO (Thread-1055) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 617589 ERROR (Thread-1055) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 617685 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:63797
[junit4] 2> 617697 INFO (zkConnectionManagerCallback-1550-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617703 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 617705 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 617705 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 617705 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 617705 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c41f8f5{/solr,null,AVAILABLE}
[junit4] 2> 617707 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f2aab8{HTTP/1.1,[http/1.1]}{127.0.0.1:63799}
[junit4] 2> 617707 INFO (jetty-launcher-1547-thread-1) [ ] o.e.j.s.Server Started @626541ms
[junit4] 2> 617707 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63799}
[junit4] 2> 617708 ERROR (jetty-launcher-1547-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 617708 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 617708 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 617708 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 617708 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-11T23:08:28.655Z
[junit4] 2> 617711 INFO (zkConnectionManagerCallback-1552-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617712 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 617750 INFO (jetty-launcher-1547-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63797/solr
[junit4] 2> 617755 INFO (zkConnectionManagerCallback-1556-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617760 INFO (zkConnectionManagerCallback-1558-thread-1-processing-n:127.0.0.1:63799_solr) [n:127.0.0.1:63799_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 617998 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 617999 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63799_solr
[junit4] 2> 618001 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.Overseer Overseer (id=72064932137205763-127.0.0.1:63799_solr-n_0000000000) starting
[junit4] 2> 618015 INFO (zkConnectionManagerCallback-1563-thread-1-processing-n:127.0.0.1:63799_solr) [n:127.0.0.1:63799_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 618020 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:63797/solr ready
[junit4] 2> 618022 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63799_solr
[junit4] 2> 618022 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 618025 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 618028 INFO (OverseerStateUpdate-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 618030 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
[junit4] 2> 618030 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 618031 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 618032 INFO (zkCallback-1562-thread-1-processing-n:127.0.0.1:63799_solr) [n:127.0.0.1:63799_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 618044 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 618045 DEBUG (OverseerAutoScalingTriggerThread-72064932137205763-127.0.0.1:63799_solr-n_0000000000) [n:127.0.0.1:63799_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 618046 DEBUG (ScheduledTrigger-2318-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618170 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63799.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@674c7244
[junit4] 2> 618180 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63799.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@674c7244
[junit4] 2> 618180 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_63799.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@674c7244
[junit4] 2> 618182 INFO (jetty-launcher-1547-thread-1) [n:127.0.0.1:63799_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_45C8B56ADD3512BF-001/tempDir-001/node1/.
[junit4] 2> 618211 INFO (zkConnectionManagerCallback-1565-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 618218 INFO (zkConnectionManagerCallback-1569-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 618221 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 618222 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:63797/solr ready
[junit4] 2> 618231 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 618231 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 618233 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10007_solr]
[junit4] 2> 618233 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 618233 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 618233 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 618233 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 618234 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618245 INFO (TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[45C8B56ADD3512BF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerDefaults
[junit4] 2> 618246 INFO (TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[45C8B56ADD3512BF]) [ ] o.a.s.c.a.ScheduledMaintenanceTriggerTest {
[junit4] 2> "cluster-preferences":[
[junit4] 2> {
[junit4] 2> "minimize":"cores",
[junit4] 2> "precision":1},
[junit4] 2> {"maximize":"freedisk"}],
[junit4] 2> "triggers":{
[junit4] 2> ".scheduled_maintenance":{
[junit4] 2> "name":".scheduled_maintenance",
[junit4] 2> "startTime":"NOW",
[junit4] 2> "event":"scheduled",
[junit4] 2> "every":"+1DAY",
[junit4] 2> "actions":[
[junit4] 2> {
[junit4] 2> "name":"inactive_shard_plan",
[junit4] 2> "class":"solr.InactiveShardPlanAction"},
[junit4] 2> {
[junit4] 2> "name":"execute_plan",
[junit4] 2> "class":"solr.ExecutePlanAction"}],
[junit4] 2> "enabled":true},
[junit4] 2> ".auto_add_replicas":{
[junit4] 2> "name":".auto_add_replicas",
[junit4] 2> "event":"nodeLost",
[junit4] 2> "waitFor":120,
[junit4] 2> "actions":[
[junit4] 2> {
[junit4] 2> "name":"auto_add_replicas_plan",
[junit4] 2> "class":"solr.AutoAddReplicasPlanAction"},
[junit4] 2> {
[junit4] 2> "name":"execute_plan",
[junit4] 2> "class":"solr.ExecutePlanAction"}],
[junit4] 2> "enabled":true}},
[junit4] 2> "listeners":{
[junit4] 2> ".scheduled_maintenance.system":{
[junit4] 2> "trigger":".scheduled_maintenance",
[junit4] 2> "afterAction":[],
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED",
[junit4] 2> "BEFORE_ACTION",
[junit4] 2> "AFTER_ACTION",
[junit4] 2> "IGNORED"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
[junit4] 2> "beforeAction":[]},
[junit4] 2> ".auto_add_replicas.system":{
[junit4] 2> "trigger":".auto_add_replicas",
[junit4] 2> "afterAction":[],
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED",
[junit4] 2> "BEFORE_ACTION",
[junit4] 2> "AFTER_ACTION",
[junit4] 2> "IGNORED"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
[junit4] 2> "beforeAction":[]}},
[junit4] 2> "properties":{}}
[junit4] 2> 618248 DEBUG (simCloudManagerPool-2324-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 618248 DEBUG (simCloudManagerPool-2324-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 618249 DEBUG (simCloudManagerPool-2324-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10007_solr]
[junit4] 2> 618249 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 618249 INFO (TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[45C8B56ADD3512BF]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTriggerDefaults
[junit4] 2> 618250 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 618250 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 618255 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618277 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618281 INFO (TEST-ScheduledMaintenanceTriggerTest.testInactiveShardCleanup-seed#[45C8B56ADD3512BF]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testInactiveShardCleanup
[junit4] 2> 618300 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618328 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618356 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618382 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618408 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618432 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618462 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618468 DEBUG (simCloudManagerPool-2324-thread-5) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for ScheduledMaintenanceTriggerTest_collection1 / shard1: {"core_node1":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "core":"ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"ScheduledMaintenanceTriggerTest_collection1"}}
[junit4] 2> 618469 DEBUG (simCloudManagerPool-2324-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for ScheduledMaintenanceTriggerTest_collection1 / shard1_0: {"core_node4":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10007/solr",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "core":"ScheduledMaintenanceTriggerTest_collection1_shard1_0_replica0",
[junit4] 2> "shard":"shard1_0",
[junit4] 2> "collection":"ScheduledMaintenanceTriggerTest_collection1"}}
[junit4] 2> 618469 DEBUG (simCloudManagerPool-2324-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for ScheduledMaintenanceTriggerTest_collection1 / shard1_1: {"core_node5":{
[junit4] 2> "node_name":"127.0.0.1:10007_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10007/solr",
[junit4] 2> "leader":"true",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "core":"ScheduledMaintenanceTriggerTest_collection1_shard1_1_replica0",
[junit4] 2> "shard":"shard1_1",
[junit4] 2> "collection":"ScheduledMaintenanceTriggerTest_collection1"}}
[junit4] 2> 618471 DEBUG (simCloudManagerPool-2324-thread-8) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 618472 DEBUG (simCloudManagerPool-2324-thread-8) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 618472 DEBUG (simCloudManagerPool-2324-thread-8) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10007_solr]
[junit4] 2> 618472 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 618472 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 618472 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 618474 DEBUG (simCloudManagerPool-2324-thread-9) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 618474 DEBUG (simCloudManagerPool-2324-thread-9) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 618475 DEBUG (simCloudManagerPool-2324-thread-9) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10007_solr]
[junit4] 2> 618475 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 618475 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 618475 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 618475 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:31.179Z. Now: 2018-03-12T03:46:16.979Z
[junit4] 2> 618476 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752964bTel6e1u6bfr4klkdvpy818yb3o",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809711179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826376979},
[junit4] 2> "ignored":true}
[junit4] 2> 618485 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618499 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:33.179Z. Now: 2018-03-12T03:46:18.162Z
[junit4] 2> 618500 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217529e1bTel6e1u6bfr4klkdvpy818yb3q",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809713179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826378162},
[junit4] 2> "ignored":true}
[junit4] 2> 618509 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618525 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:35.179Z. Now: 2018-03-12T03:46:19.464Z
[junit4] 2> 618525 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752a5ebTel6e1u6bfr4klkdvpy818yb3s",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809715179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826379464},
[junit4] 2> "ignored":true}
[junit4] 2> 618530 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618552 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618552 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:37.179Z. Now: 2018-03-12T03:46:20.824Z
[junit4] 2> 618552 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752adbbTel6e1u6bfr4klkdvpy818yb3u",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809717179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826380824},
[junit4] 2> "ignored":true}
[junit4] 2> 618582 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618583 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:39.179Z. Now: 2018-03-12T03:46:22.340Z
[junit4] 2> 618583 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752b58bTel6e1u6bfr4klkdvpy818yb3w",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809719179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826382340},
[junit4] 2> "ignored":true}
[junit4] 2> 618611 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618611 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:41.179Z. Now: 2018-03-12T03:46:23.767Z
[junit4] 2> 618611 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752bd5bTel6e1u6bfr4klkdvpy818yb3y",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809721179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826383767},
[junit4] 2> "ignored":true}
[junit4] 2> 618643 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618643 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:43.179Z. Now: 2018-03-12T03:46:25.343Z
[junit4] 2> 618643 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752c52bTel6e1u6bfr4klkdvpy818yb40",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809723179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826385343},
[junit4] 2> "ignored":true}
[junit4] 2> 618673 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618674 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:45.179Z. Now: 2018-03-12T03:46:26.883Z
[junit4] 2> 618674 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752ccfbTel6e1u6bfr4klkdvpy818yb42",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809725179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826386883},
[junit4] 2> "ignored":true}
[junit4] 2> 618704 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618704 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:47.179Z. Now: 2018-03-12T03:46:28.429Z
[junit4] 2> 618707 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752d4cbTel6e1u6bfr4klkdvpy818yb44",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809727179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826388429},
[junit4] 2> "ignored":true}
[junit4] 2> 618733 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618733 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:49.179Z. Now: 2018-03-12T03:46:29.847Z
[junit4] 2> 618733 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752dc9bTel6e1u6bfr4klkdvpy818yb46",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809729179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826389847},
[junit4] 2> "ignored":true}
[junit4] 2> 618762 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618762 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:51.179Z. Now: 2018-03-12T03:46:31.332Z
[junit4] 2> 618763 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752e46bTel6e1u6bfr4klkdvpy818yb48",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809731179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826391332},
[junit4] 2> "ignored":true}
[junit4] 2> 618792 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618792 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:53.179Z. Now: 2018-03-12T03:46:32.795Z
[junit4] 2> 618792 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752ec3bTel6e1u6bfr4klkdvpy818yb4a",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809733179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826392795},
[junit4] 2> "ignored":true}
[junit4] 2> 618812 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618813 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:55.179Z. Now: 2018-03-12T03:46:33.851Z
[junit4] 2> 618813 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752f40bTel6e1u6bfr4klkdvpy818yb4c",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809735179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826393851},
[junit4] 2> "ignored":true}
[junit4] 2> 618840 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618840 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:57.179Z. Now: 2018-03-12T03:46:35.230Z
[junit4] 2> 618841 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621752fbdbTel6e1u6bfr4klkdvpy818yb4e",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809737179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826395230},
[junit4] 2> "ignored":true}
[junit4] 2> 618871 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618871 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:08:59.179Z. Now: 2018-03-12T03:46:36.748Z
[junit4] 2> 618871 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175303abTel6e1u6bfr4klkdvpy818yb4g",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809739179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826396748},
[junit4] 2> "ignored":true}
[junit4] 2> 618900 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618900 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:01.179Z. Now: 2018-03-12T03:46:38.227Z
[junit4] 2> 618901 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217530b7bTel6e1u6bfr4klkdvpy818yb4i",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809741179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826398227},
[junit4] 2> "ignored":true}
[junit4] 2> 618930 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618930 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:03.179Z. Now: 2018-03-12T03:46:39.726Z
[junit4] 2> 618931 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753134bTel6e1u6bfr4klkdvpy818yb4k",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809743179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826399726},
[junit4] 2> "ignored":true}
[junit4] 2> 618959 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618959 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:05.179Z. Now: 2018-03-12T03:46:41.157Z
[junit4] 2> 618959 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217531b1bTel6e1u6bfr4klkdvpy818yb4m",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809745179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826401157},
[junit4] 2> "ignored":true}
[junit4] 2> 618979 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 618980 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:07.179Z. Now: 2018-03-12T03:46:42.216Z
[junit4] 2> 618980 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175322ebTel6e1u6bfr4klkdvpy818yb4o",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809747179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826402216},
[junit4] 2> "ignored":true}
[junit4] 2> 619001 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619001 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:09.179Z. Now: 2018-03-12T03:46:43.277Z
[junit4] 2> 619002 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217532abbTel6e1u6bfr4klkdvpy818yb4q",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809749179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826403277},
[junit4] 2> "ignored":true}
[junit4] 2> 619022 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619023 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:11.179Z. Now: 2018-03-12T03:46:44.344Z
[junit4] 2> 619023 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753328bTel6e1u6bfr4klkdvpy818yb4s",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809751179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826404344},
[junit4] 2> "ignored":true}
[junit4] 2> 619047 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619048 DEBUG (ScheduledTrigger-2318-thread-2) [n:127.0.0.1:63799_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619048 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:13.179Z. Now: 2018-03-12T03:46:45.612Z
[junit4] 2> 619048 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217533a5bTel6e1u6bfr4klkdvpy818yb4u",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809753179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826405612},
[junit4] 2> "ignored":true}
[junit4] 2> 619070 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619070 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:15.179Z. Now: 2018-03-12T03:46:46.710Z
[junit4] 2> 619070 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753422bTel6e1u6bfr4klkdvpy818yb4w",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809755179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826406710},
[junit4] 2> "ignored":true}
[junit4] 2> 619090 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619090 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:17.179Z. Now: 2018-03-12T03:46:47.723Z
[junit4] 2> 619090 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175349fbTel6e1u6bfr4klkdvpy818yb4y",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809757179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826407723},
[junit4] 2> "ignored":true}
[junit4] 2> 619111 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619111 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:19.179Z. Now: 2018-03-12T03:46:48.777Z
[junit4] 2> 619112 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175351cbTel6e1u6bfr4klkdvpy818yb50",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809759179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826408777},
[junit4] 2> "ignored":true}
[junit4] 2> 619135 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619135 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:21.179Z. Now: 2018-03-12T03:46:49.942Z
[junit4] 2> 619135 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753599bTel6e1u6bfr4klkdvpy818yb52",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809761179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826409942},
[junit4] 2> "ignored":true}
[junit4] 2> 619155 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619156 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:23.179Z. Now: 2018-03-12T03:46:51.001Z
[junit4] 2> 619156 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753616bTel6e1u6bfr4klkdvpy818yb54",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809763179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826411001},
[junit4] 2> "ignored":true}
[junit4] 2> 619180 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619180 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:25.179Z. Now: 2018-03-12T03:46:52.233Z
[junit4] 2> 619181 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753693bTel6e1u6bfr4klkdvpy818yb56",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809765179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826412233},
[junit4] 2> "ignored":true}
[junit4] 2> 619201 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619201 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:27.179Z. Now: 2018-03-12T03:46:53.284Z
[junit4] 2> 619201 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753710bTel6e1u6bfr4klkdvpy818yb58",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809767179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826413284},
[junit4] 2> "ignored":true}
[junit4] 2> 619221 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619222 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:29.179Z. Now: 2018-03-12T03:46:54.300Z
[junit4] 2> 619222 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175378dbTel6e1u6bfr4klkdvpy818yb5a",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809769179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826414300},
[junit4] 2> "ignored":true}
[junit4] 2> 619242 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619243 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:31.179Z. Now: 2018-03-12T03:46:55.345Z
[junit4] 2> 619243 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175380abTel6e1u6bfr4klkdvpy818yb5c",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809771179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826415345},
[junit4] 2> "ignored":true}
[junit4] 2> 619262 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619264 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:33.179Z. Now: 2018-03-12T03:46:56.396Z
[junit4] 2> 619264 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753887bTel6e1u6bfr4klkdvpy818yb5e",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809773179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826416396},
[junit4] 2> "ignored":true}
[junit4] 2> 619283 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619285 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:35.179Z. Now: 2018-03-12T03:46:57.466Z
[junit4] 2> 619285 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753904bTel6e1u6bfr4klkdvpy818yb5g",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809775179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826417466},
[junit4] 2> "ignored":true}
[junit4] 2> 619303 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619306 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:37.179Z. Now: 2018-03-12T03:46:58.515Z
[junit4] 2> 619306 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753981bTel6e1u6bfr4klkdvpy818yb5i",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809777179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826418515},
[junit4] 2> "ignored":true}
[junit4] 2> 619323 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619329 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:39.179Z. Now: 2018-03-12T03:46:59.657Z
[junit4] 2> 619329 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217539febTel6e1u6bfr4klkdvpy818yb5k",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809779179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826419657},
[junit4] 2> "ignored":true}
[junit4] 2> 619350 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619350 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:41.179Z. Now: 2018-03-12T03:47:00.708Z
[junit4] 2> 619350 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753a7bbTel6e1u6bfr4klkdvpy818yb5m",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809781179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826420708},
[junit4] 2> "ignored":true}
[junit4] 2> 619379 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619379 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:43.179Z. Now: 2018-03-12T03:47:02.142Z
[junit4] 2> 619379 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753af8bTel6e1u6bfr4klkdvpy818yb5o",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809783179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826422142},
[junit4] 2> "ignored":true}
[junit4] 2> 619409 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619409 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:45.179Z. Now: 2018-03-12T03:47:03.653Z
[junit4] 2> 619409 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753b75bTel6e1u6bfr4klkdvpy818yb5q",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809785179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826423653},
[junit4] 2> "ignored":true}
[junit4] 2> 619439 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619439 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:47.179Z. Now: 2018-03-12T03:47:05.167Z
[junit4] 2> 619439 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753bf2bTel6e1u6bfr4klkdvpy818yb5s",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809787179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826425167},
[junit4] 2> "ignored":true}
[junit4] 2> 619464 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619464 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:49.179Z. Now: 2018-03-12T03:47:06.422Z
[junit4] 2> 619464 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753c6fbTel6e1u6bfr4klkdvpy818yb5u",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809789179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826426422},
[junit4] 2> "ignored":true}
[junit4] 2> 619493 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619493 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:51.179Z. Now: 2018-03-12T03:47:07.861Z
[junit4] 2> 619493 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753cecbTel6e1u6bfr4klkdvpy818yb5w",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809791179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826427861},
[junit4] 2> "ignored":true}
[junit4] 2> 619521 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619521 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:53.179Z. Now: 2018-03-12T03:47:09.254Z
[junit4] 2> 619521 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753d69bTel6e1u6bfr4klkdvpy818yb5y",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809793179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826429254},
[junit4] 2> "ignored":true}
[junit4] 2> 619549 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619549 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:55.179Z. Now: 2018-03-12T03:47:10.675Z
[junit4] 2> 619549 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753de6bTel6e1u6bfr4klkdvpy818yb60",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809795179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826430675},
[junit4] 2> "ignored":true}
[junit4] 2> 619580 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619580 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:57.179Z. Now: 2018-03-12T03:47:12.191Z
[junit4] 2> 619580 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753e63bTel6e1u6bfr4klkdvpy818yb62",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809797179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826432191},
[junit4] 2> "ignored":true}
[junit4] 2> 619610 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619610 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:09:59.179Z. Now: 2018-03-12T03:47:13.699Z
[junit4] 2> 619610 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753ee0bTel6e1u6bfr4klkdvpy818yb64",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809799179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826433699},
[junit4] 2> "ignored":true}
[junit4] 2> 619638 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619638 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:01.179Z. Now: 2018-03-12T03:47:15.119Z
[junit4] 2> 619638 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753f5dbTel6e1u6bfr4klkdvpy818yb66",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809801179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826435119},
[junit4] 2> "ignored":true}
[junit4] 2> 619665 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619665 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:03.179Z. Now: 2018-03-12T03:47:16.473Z
[junit4] 2> 619665 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621753fdabTel6e1u6bfr4klkdvpy818yb68",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809803179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826436473},
[junit4] 2> "ignored":true}
[junit4] 2> 619686 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619687 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:05.179Z. Now: 2018-03-12T03:47:17.582Z
[junit4] 2> 619688 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621754057bTel6e1u6bfr4klkdvpy818yb6a",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809805179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826437582},
[junit4] 2> "ignored":true}
[junit4] 2> 619706 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619709 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:07.179Z. Now: 2018-03-12T03:47:18.645Z
[junit4] 2> 619709 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217540d4bTel6e1u6bfr4klkdvpy818yb6c",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809807179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826438645},
[junit4] 2> "ignored":true}
[junit4] 2> 619727 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619735 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:09.179Z. Now: 2018-03-12T03:47:19.970Z
[junit4] 2> 619735 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621754151bTel6e1u6bfr4klkdvpy818yb6e",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809809179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826439970},
[junit4] 2> "ignored":true}
[junit4] 2> 619747 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619757 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:11.179Z. Now: 2018-03-12T03:47:21.034Z
[junit4] 2> 619757 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217541cebTel6e1u6bfr4klkdvpy818yb6g",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809811179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826441034},
[junit4] 2> "ignored":true}
[junit4] 2> 619768 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619779 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:13.179Z. Now: 2018-03-12T03:47:22.170Z
[junit4] 2> 619779 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175424bbTel6e1u6bfr4klkdvpy818yb6i",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809813179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826442170},
[junit4] 2> "ignored":true}
[junit4] 2> 619790 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619810 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619810 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:15.179Z. Now: 2018-03-12T03:47:23.729Z
[junit4] 2> 619811 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217542c8bTel6e1u6bfr4klkdvpy818yb6k",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809815179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826443729},
[junit4] 2> "ignored":true}
[junit4] 2> 619832 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619832 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:17.179Z. Now: 2018-03-12T03:47:24.798Z
[junit4] 2> 619832 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621754345bTel6e1u6bfr4klkdvpy818yb6m",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809817179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826444798},
[junit4] 2> "ignored":true}
[junit4] 2> 619862 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619862 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:19.179Z. Now: 2018-03-12T03:47:26.324Z
[junit4] 2> 619862 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217543c2bTel6e1u6bfr4klkdvpy818yb6o",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809819179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826446324},
[junit4] 2> "ignored":true}
[junit4] 2> 619892 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619892 WARN (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:21.179Z. Now: 2018-03-12T03:47:27.823Z
[junit4] 2> 619892 DEBUG (ScheduledTrigger-2325-thread-3) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175443fbTel6e1u6bfr4klkdvpy818yb6q",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809821179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826447823},
[junit4] 2> "ignored":true}
[junit4] 2> 619917 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619917 WARN (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:23.179Z. Now: 2018-03-12T03:47:29.043Z
[junit4] 2> 619917 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217544bcbTel6e1u6bfr4klkdvpy818yb6s",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809823179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826449043},
[junit4] 2> "ignored":true}
[junit4] 2> 619937 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619938 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:25.179Z. Now: 2018-03-12T03:47:30.090Z
[junit4] 2> 619938 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621754539bTel6e1u6bfr4klkdvpy818yb6u",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809825179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826450090},
[junit4] 2> "ignored":true}
[junit4] 2> 619961 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619961 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:27.179Z. Now: 2018-03-12T03:47:31.249Z
[junit4] 2> 619961 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217545b6bTel6e1u6bfr4klkdvpy818yb6w",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809827179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826451249},
[junit4] 2> "ignored":true}
[junit4] 2> 619984 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 619984 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:29.179Z. Now: 2018-03-12T03:47:32.406Z
[junit4] 2> 619984 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"1621754633bTel6e1u6bfr4klkdvpy818yb6y",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809829179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826452406},
[junit4] 2> "ignored":true}
[junit4] 2> 620011 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 620011 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:31.179Z. Now: 2018-03-12T03:47:33.746Z
[junit4] 2> 620011 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217546b0bTel6e1u6bfr4klkdvpy818yb70",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809831179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826453746},
[junit4] 2> "ignored":true}
[junit4] 2> 620033 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 620034 WARN (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:33.179Z. Now: 2018-03-12T03:47:34.884Z
[junit4] 2> 620034 DEBUG (ScheduledTrigger-2325-thread-4) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"162175472dbTel6e1u6bfr4klkdvpy818yb72",
[junit4] 2> "source":".scheduled_maintenance",
[junit4] 2> "eventTime":1520809833179,
[junit4] 2> "eventType":"SCHEDULED",
[junit4] 2> "properties":{"actualEventTime":1520826454884},
[junit4] 2> "ignored":true}
[junit4] 2> 620054 DEBUG (ScheduledTrigger-2318-thread-4) [n:127.0.0.1:63799_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 620054 DEBUG (ScheduledTrigger-2325-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
[junit4] 2> 620058 WARN (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger was not able to run event at scheduled time: 2018-03-11T23:10:35.179Z. Now: 2018-03-12T03:47:36.110Z
[junit4] 2> 620058 DEBUG (ScheduledTrigger-2325-thread-2) [ ] o.a.s.c.a.ScheduledTriggers -------- Ignoring event: {
[junit4] 2> "id":"16217547aabTel6e1
[...truncated too long message...]
2> org.apache.lucene.store.AlreadyClosedException: ScheduledTrigger .scheduled_maintenance has been closed.
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.dequeue(ScheduledTriggers.java:532)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:317)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 11727 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
[junit4] 2> 11727 DEBUG (AutoscalingActionExecutor-29-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 483 ms for event id=698c4cfbab6bTel6e1u6bfr4klkdvpy818y9n6
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ScheduledMaintenanceTriggerTest -Dtests.method=testInactiveShardCleanup -Dtests.seed=45C8B56ADD3512BF -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=es-GT -Dtests.timezone=America/Nipigon -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.21s J1 | ScheduledMaintenanceTriggerTest.testInactiveShardCleanup <<<
[junit4] > Throwable #1: java.lang.AssertionError: should be at least one inactive event
[junit4] > at __randomizedtesting.SeedInfo.seed([45C8B56ADD3512BF:58E47518BC7635B4]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:218)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 11728 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 11728 DEBUG (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 11734 INFO (jetty-closer-25-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@568b7ea9{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 11734 INFO (jetty-closer-25-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2141239750
[junit4] 2> 11734 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 11735 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6bf8cb1e: rootName = solr_64655, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6fa508b4
[junit4] 2> 11746 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 11746 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@31e6a73b: rootName = solr_64655, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4221df9e
[junit4] 2> 11750 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 11751 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3d964a8c: rootName = solr_64655, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a939e89
[junit4] 2> 11753 INFO (jetty-closer-25-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:64655_solr
[junit4] 2> 11755 INFO (jetty-closer-25-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 11755 INFO (zkCallback-34-thread-1-processing-n:127.0.0.1:64655_solr) [n:127.0.0.1:64655_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 11755 INFO (zkCallback-39-thread-1-processing-n:127.0.0.1:64655_solr) [n:127.0.0.1:64655_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 11755 INFO (jetty-closer-25-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 11756 INFO (jetty-closer-25-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72065191607336963-127.0.0.1:64655_solr-n_0000000000) closing
[junit4] 2> 11756 INFO (OverseerStateUpdate-72065191607336963-127.0.0.1:64655_solr-n_0000000000) [n:127.0.0.1:64655_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:64655_solr
[junit4] 2> 11756 WARN (OverseerAutoScalingTriggerThread-72065191607336963-127.0.0.1:64655_solr-n_0000000000) [n:127.0.0.1:64655_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 11758 DEBUG (jetty-closer-25-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 11760 INFO (jetty-closer-25-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6eb8591{/solr,null,UNAVAILABLE}
[junit4] 2> 11761 INFO (jetty-closer-25-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 11761 ERROR (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 11762 INFO (SUITE-ScheduledMaintenanceTriggerTest-seed#[45C8B56ADD3512BF]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64652 64652
[junit4] 2> 11795 INFO (Thread-12) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64652 64652
[junit4] 2> 12156 WARN (Thread-12) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_45C8B56ADD3512BF-001
[junit4] 2> Mar 12, 2018 12:14:29 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1160, maxMBSortInHeap=6.978334250964279, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@537db9e3), locale=es-GT, timezone=America/Nipigon
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=20287200,total=56623104
[junit4] 2> NOTE: All tests run in this JVM: [ScheduledMaintenanceTriggerTest, ScheduledMaintenanceTriggerTest]
[junit4] Completed [5/5 (3!)] on J1 in 1.58s, 2 tests, 1 failure <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:1561: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:1085: There were test failures: 5 suites, 10 tests, 3 failures [seed: 45C8B56ADD3512BF]
Total time: 19 seconds
[repro] Setting last failure code to 256
[repro] Failures:
[repro] 3/5 failed: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=8f1350af20c682df7b7fb9e3af762e03b944fdb9, workspace=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX
[WARNINGS] Computing warning deltas based on reference build #4489
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2