You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/08 01:06:34 UTC
[JENKINS] Lucene-Solr-Tests-master - Build # 2521 - Still Unstable
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2521/
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
Error Message:
did not finish processing in time
Stack Trace:
java.lang.AssertionError: did not finish processing in time
at __randomizedtesting.SeedInfo.seed([8F301B8FD3EE943:5B4A43081F2F7CB9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:404)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13145 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[junit4] 2> 802241 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_8F301B8FD3EE943-001/init-core-data-001
[junit4] 2> 802242 WARN (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 802242 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 802244 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 802245 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_8F301B8FD3EE943-001/tempDir-001
[junit4] 2> 802245 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 802268 INFO (Thread-1337) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 802268 INFO (Thread-1337) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 802284 ERROR (Thread-1337) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 802414 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57019
[junit4] 2> 802448 INFO (zkConnectionManagerCallback-1563-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802468 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 802469 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 802472 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 802472 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 802473 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 802473 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3ca24aa6{/solr,null,AVAILABLE}
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@756c0f2a{SSL,[ssl, http/1.1]}{127.0.0.1:44626}
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.e.j.s.Server Started @802542ms
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44626}
[junit4] 2> 802474 ERROR (jetty-launcher-1560-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 802474 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-07T23:49:57.709Z
[junit4] 2> 802477 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 802477 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 802477 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 802478 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f551540{/solr,null,AVAILABLE}
[junit4] 2> 802478 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4857014a{SSL,[ssl, http/1.1]}{127.0.0.1:51818}
[junit4] 2> 802478 INFO (jetty-launcher-1560-thread-2) [ ] o.e.j.s.Server Started @802547ms
[junit4] 2> 802478 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51818}
[junit4] 2> 802479 ERROR (jetty-launcher-1560-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 802479 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 802479 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 802479 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 802479 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 802479 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-07T23:49:57.714Z
[junit4] 2> 802481 INFO (zkConnectionManagerCallback-1565-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802481 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 802489 INFO (zkConnectionManagerCallback-1567-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802490 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 802499 INFO (jetty-launcher-1560-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57019/solr
[junit4] 2> 802503 INFO (jetty-launcher-1560-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57019/solr
[junit4] 2> 802504 INFO (zkConnectionManagerCallback-1571-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802506 INFO (zkConnectionManagerCallback-1575-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802509 INFO (zkConnectionManagerCallback-1577-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802519 INFO (zkConnectionManagerCallback-1579-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802635 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 802636 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51818_solr
[junit4] 2> 802645 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.Overseer Overseer (id=73760802230829062-127.0.0.1:51818_solr-n_0000000000) starting
[junit4] 2> 802652 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 802654 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44626_solr
[junit4] 2> 802804 INFO (zkCallback-1578-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 802812 INFO (zkCallback-1576-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 802824 INFO (zkConnectionManagerCallback-1588-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 802825 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 802826 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57019/solr ready
[junit4] 2> 802850 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 802850 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51818_solr
[junit4] 2> 802851 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 802852 INFO (zkCallback-1576-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 802853 INFO (zkCallback-1578-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 802854 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 802858 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 802858 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 802912 INFO (zkCallback-1587-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 802918 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:44626_solr, 127.0.0.1:51818_solr]
[junit4] 2> 802940 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 802941 DEBUG (ScheduledTrigger-1643-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 802941 DEBUG (OverseerAutoScalingTriggerThread-73760802230829062-127.0.0.1:51818_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 803705 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51818.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803707 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44626.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803759 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44626.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803759 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44626.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803760 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51818.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803760 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51818.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@523292e5
[junit4] 2> 803761 INFO (jetty-launcher-1560-thread-2) [n:127.0.0.1:51818_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_8F301B8FD3EE943-001/tempDir-001/node2/.
[junit4] 2> 803765 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_8F301B8FD3EE943-001/tempDir-001/node1/.
[junit4] 2> 804021 DEBUG (ScheduledTrigger-1643-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804021 INFO (zkConnectionManagerCallback-1593-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804022 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 804024 INFO (jetty-launcher-1560-thread-1) [n:127.0.0.1:44626_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57019/solr ready
[junit4] 2> 804078 INFO (zkConnectionManagerCallback-1595-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804107 INFO (zkConnectionManagerCallback-1600-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 804108 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 804110 INFO (SUITE-IndexSizeTriggerTest-seed#[8F301B8FD3EE943]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57019/solr ready
[junit4] 2> 804137 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 804137 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
[junit4] 2> 804137 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
[junit4] 2> 804137 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
[junit4] 2> 804141 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
[junit4] 2> 804142 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 804142 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
[junit4] 2> 804145 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804166 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804186 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804206 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804226 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804246 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804267 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804287 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804307 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804327 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804347 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804355 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger
[junit4] 2> 804367 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804388 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804408 DEBUG (ScheduledTrigger-1652-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804428 DEBUG (ScheduledTrigger-1652-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804448 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804448 DEBUG (simCloudManagerPool-1651-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 804456 DEBUG (simCloudManagerPool-1651-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testTrigger_collection"}}
[junit4] 2> 804468 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804489 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804509 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804529 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804549 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804569 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804590 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804610 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804630 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804650 DEBUG (ScheduledTrigger-1652-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 804667 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testTrigger_collection]
[junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/28)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testTrigger_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testTrigger_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testTrigger_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - update 26
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2>
[junit4] 2> 804668 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 804668 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 804668 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 804668 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 804668 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 804769 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger
[junit4] 2> 804799 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration
[junit4] 2> 804844 DEBUG (simCloudManagerPool-1651-thread-39) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 804845 DEBUG (simCloudManagerPool-1651-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 804855 DEBUG (simCloudManagerPool-1651-thread-41) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 804855 DEBUG (simCloudManagerPool-1651-thread-41) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 804855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 804855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 804856 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 804856 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 804857 DEBUG (simCloudManagerPool-1651-thread-42) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 804857 DEBUG (simCloudManagerPool-1651-thread-42) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 804857 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 804858 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 804858 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 804858 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 804866 DEBUG (simCloudManagerPool-1651-thread-43) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 804866 DEBUG (simCloudManagerPool-1651-thread-43) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 804866 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 804867 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 804867 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 804867 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 805001 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 805002 DEBUG (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger]
[junit4] 2> 805004 INFO (ScheduledTrigger-1652-thread-2) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988940845497211, stage=STARTED, actionName='null', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805020 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}
[junit4] 2> 805021 DEBUG (ScheduledTrigger-1643-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 805025 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988941784246861, stage=BEFORE_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805025 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: {
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]}
[junit4] 2> 805028 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 805029 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 805029 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 25988942121 sessionWrapper.createTime 25988941979540911, this.sessionWrapper.createTime 25988941979540911
[junit4] 2> 805030 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988942138846161, stage=AFTER_ACTION, actionName='compute_plan', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805031 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988942184811861, stage=BEFORE_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805031 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@561c34ac, org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@4cdbe2a8], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 805031 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1
[junit4] 2> 805189 DEBUG (simCloudManagerPool-1651-thread-74) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1",
[junit4] 2> "shard":"shard1_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 805190 DEBUG (simCloudManagerPool-1651-thread-75) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7,
[junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0",
[junit4] 2> "shard":"shard1_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 805192 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2
[junit4] 2> 805348 DEBUG (simCloudManagerPool-1651-thread-81) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_1: {"core_node16":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1",
[junit4] 2> "shard":"shard2_1",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 805349 DEBUG (simCloudManagerPool-1651-thread-84) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_0: {"core_node14":{
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":6,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":6,
[junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1",
[junit4] 2> "shard":"shard2_0",
[junit4] 2> "collection":"testSplitIntegration_collection"}}
[junit4] 2> 805349 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988958118574661, stage=AFTER_ACTION, actionName='execute_plan', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger/5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805350 INFO (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25988958167535011, stage=SUCCEEDED, actionName='null', event={
[junit4] 2> "id":"5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47",
[junit4] 2> "source":"index_size_trigger",
[junit4] 2> "eventTime":25988933460804211,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{"testSplitIntegration_collection":[
[junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}",
[junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":25988940779870961,
[junit4] 2> "requestedOps":[
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}",
[junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={
[junit4] 2> "trigger":"index_size_trigger",
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED"],
[junit4] 2> "afterAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"],
[junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener",
[junit4] 2> "beforeAction":[
[junit4] 2> "compute_plan",
[junit4] 2> "execute_plan"]}, message='null'}
[junit4] 2> 805354 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testSplitIntegration_collection]
[junit4] 2> DocCollection(testSplitIntegration_collection//clusterstate.json/63)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "stateTimestamp":"1525737060317114250",
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":11,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":11}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"inactive"},
[junit4] 2> "shard1":{
[junit4] 2> "stateTimestamp":"1525737052756446050",
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n2",
[junit4] 2> "SEARCHER.searcher.maxDoc":14,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":14}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"inactive"},
[junit4] 2> "shard2_1":{
[junit4] 2> "parent":"shard2",
[junit4] 2> "stateTimestamp":"1525737060319619000",
[junit4] 2> "range":"40000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node16":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5},
[junit4] 2> "core_node15":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":5,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":5}}},
[junit4] 2> "shard1_1":{
[junit4] 2> "parent":"shard1",
[junit4] 2> "stateTimestamp":"1525737052786556500",
[junit4] 2> "range":"c0000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node10":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7},
[junit4] 2> "core_node9":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7}}},
[junit4] 2> "shard1_0":{
[junit4] 2> "parent":"shard1",
[junit4] 2> "stateTimestamp":"1525737052786221600",
[junit4] 2> "range":"80000000-bfffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node7":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7},
[junit4] 2> "core_node8":{
[junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":7}}},
[junit4] 2> "shard2_0":{
[junit4] 2> "parent":"shard2",
[junit4] 2> "stateTimestamp":"1525737060317659100",
[junit4] 2> "range":"0-3fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node14":{
[junit4] 2> "leader":"true",
[junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1",
[junit4] 2> "SEARCHER.searcher.maxDoc":6,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10000/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":6},
[junit4] 2> "core_node13":{
[junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica0",
[junit4] 2> "SEARCHER.searcher.maxDoc":6,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "base_url":"http://127.0.0.1:10001/solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":6}}}}}
[junit4] 2> ## Max replicas per node: 6
[junit4] 2> ## Min replicas per node: 6
[junit4] 2> ## Total replicas: 12
[junit4] 2> ## * testSplitIntegration_collection 12
[junit4] 2> ## - active 12
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - DELETESTATUS 2
[junit4] 2> ## - REQUESTSTATUS 2
[junit4] 2> ## - SPLITSHARD 2
[junit4] 2> ## - autoscaling 3
[junit4] 2> ## - update 27
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2> ## * Trigger: index_size_trigger
[junit4] 2> ## - STARTED 1
[junit4] 2>
[junit4] 2> 805354 DEBUG (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 805355 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger after 100ms
[junit4] 2> 805355 DEBUG (AutoscalingActionExecutor-1653-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 16766 ms for event id=5c54cc1b05c273T6s05ogps2m2d8virc3zxz1i47
[junit4] 2> 805356 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 805356 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 805356 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 805356 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 805457 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSplitIntegration
[junit4] 2> 805511 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMixedBounds
[junit4] 2> 805511 WARN (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.IndexSizeTriggerTest Requires SOLR-12208
[junit4] 2> 805511 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 2
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: []
[junit4] 2> ## Max replicas per node: 0
[junit4] 2> ## Min replicas per node: 0
[junit4] 2> ## Total replicas: 0
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - update 1
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2> ## * Trigger: index_size_trigger
[junit4] 2> ## - STARTED 1
[junit4] 2> ## - SUCCEEDED 1
[junit4] 2>
[junit4] 2> 805512 DEBUG (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 805512 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 805512 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 805512 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 805512 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 805612 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMixedBounds
[junit4] 2> 805662 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration
[junit4] 2> 805692 DEBUG (simCloudManagerPool-1651-thread-94) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node2":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":0,
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testMergeIntegration_collection"}}
[junit4] 2> 805736 DEBUG (simCloudManagerPool-1651-thread-106) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 805736 DEBUG (simCloudManagerPool-1651-thread-106) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 805736 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 805736 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 805736 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 805736 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 805740 DEBUG (simCloudManagerPool-1651-thread-107) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 805740 DEBUG (simCloudManagerPool-1651-thread-107) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 805740 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 805740 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 805740 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 805740 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 805742 DEBUG (simCloudManagerPool-1651-thread-108) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 805742 DEBUG (simCloudManagerPool-1651-thread-108) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 805742 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 805743 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 805743 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 805743 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 806021 DEBUG (ScheduledTrigger-1643-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 807024 DEBUG (ScheduledTrigger-1643-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
[junit4] 2> 807136 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.IndexSizeTriggerTest #######################################
[junit4] 2> ############ CLUSTER STATE ############
[junit4] 2> #######################################
[junit4] 2> ## Live nodes: 2
[junit4] 2> ## Empty nodes: 0
[junit4] 2> ## Dead nodes: 0
[junit4] 2> ## Collections: [testMergeIntegration_collection]
[junit4] 2> DocCollection(testMergeIntegration_collection//clusterstate.json/86)={
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"2",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "autoCreated":"true",
[junit4] 2> "shards":{
[junit4] 2> "shard2":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node3":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3},
[junit4] 2> "core_node4":{
[junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n4",
[junit4] 2> "SEARCHER.searcher.maxDoc":3,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":3}},
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active"},
[junit4] 2> "shard1":{
[junit4] 2> "replicas":{
[junit4] 2> "core_node1":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10000_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2},
[junit4] 2> "core_node2":{
[junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n2",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":7,
[junit4] 2> "SEARCHER.searcher.deletedDocs":5,
[junit4] 2> "INDEX.sizeInBytes":1,
[junit4] 2> "node_name":"127.0.0.1:10001_solr",
[junit4] 2> "state":"active",
[junit4] 2> "type":"NRT",
[junit4] 2> "SEARCHER.searcher.numDocs":2}},
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active"}}}
[junit4] 2> ## Max replicas per node: 2
[junit4] 2> ## Min replicas per node: 2
[junit4] 2> ## Total replicas: 4
[junit4] 2> ## * testMergeIntegration_collection 4
[junit4] 2> ## - active 4
[junit4] 2> ######### Solr op counts ##########
[junit4] 2> ## - CREATE 1
[junit4] 2> ## - autoscaling 3
[junit4] 2> ## - update 17
[junit4] 2> ######### Autoscaling event counts ###########
[junit4] 2> ## * Trigger: index_size_trigger
[junit4] 2> ## - STARTED 1
[junit4] 2> ## - SUCCEEDED 1
[junit4] 2>
[junit4] 2> 807136 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
[junit4] 2> 807139 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
[junit4] 2> 807141 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 807141 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 807141 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
[junit4] 2> 807237 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[8F301B8FD3EE943]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMergeIntegration
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testMergeIntegration -Dtests.seed=8F301B8FD3EE943 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Etc/GMT-5 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 1.63s J2 | IndexSizeTriggerTest.testMergeIntegration <<<
[junit4] > Throwable #1: java.lang.AssertionError: did not finish processing in time
[junit4] > at __randomizedtesting.SeedInfo.seed([8F301B8FD3EE943:5B4A43081F2F7CB9]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:404)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 807240 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted
[junit4] 2> java.lang.InterruptedException: null
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.ja
[...truncated too long message...]
pace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null785636682
[copy] Copying 40 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null785636682
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null785636682
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1006080379
[copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1006080379
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1006080379
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 36ms :: artifacts dl 2ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 158 minutes 35 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-Tests-master - Build # 2523 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2523/
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode
Error Message:
unexpected DELETENODE status: {responseHeader={status=0,QTime=7},status={state=notfound,msg=Did not find [search_rate_trigger3/5d4a898a7d9b6bT6efcosp38lbi4lcc4qrn2t7uf/0] in any tasks queue}}
Stack Trace:
java.lang.AssertionError: unexpected DELETENODE status: {responseHeader={status=0,QTime=7},status={state=notfound,msg=Did not find [search_rate_trigger3/5d4a898a7d9b6bT6efcosp38lbi4lcc4qrn2t7uf/0] in any tasks queue}}
at __randomizedtesting.SeedInfo.seed([91E9EA264AAC23FE:B37B24A47D66AC83]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.lambda$testDeleteNode$6(SearchRateTriggerIntegrationTest.java:668)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest.testDeleteNode(SearchRateTriggerIntegrationTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12667 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
[junit4] 2> 274034 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/init-core-data-001
[junit4] 2> 274042 WARN (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
[junit4] 2> 274042 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 274045 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 274047 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001
[junit4] 2> 274047 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 274065 INFO (Thread-255) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 274065 INFO (Thread-255) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 274138 ERROR (Thread-255) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 274165 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:58360
[junit4] 2> 274197 INFO (zkConnectionManagerCallback-333-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 274212 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 274215 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 274226 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 274227 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 274407 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 274407 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 274407 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 274408 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d3d9d55{/solr,null,AVAILABLE}
[junit4] 2> 274473 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 274473 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 274473 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 274478 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 274537 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 274537 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 274537 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 274549 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53ed11e4{/solr,null,AVAILABLE}
[junit4] 2> 274550 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1734fbcf{/solr,null,AVAILABLE}
[junit4] 2> 274598 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 274598 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 274598 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 274613 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14f7ef41{/solr,null,AVAILABLE}
[junit4] 2> 274628 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 274628 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 274628 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 274638 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64a8c5ef{/solr,null,AVAILABLE}
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@28dfe1c6{SSL,[ssl, http/1.1]}{127.0.0.1:41206}
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.e.j.s.Server Started @274776ms
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41206}
[junit4] 2> 274647 ERROR (jetty-launcher-330-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 274647 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 274648 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 274648 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-11T02:53:22.190Z
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3eb84b42{SSL,[ssl, http/1.1]}{127.0.0.1:57758}
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.e.j.s.Server Started @274811ms
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57758}
[junit4] 2> 274682 ERROR (jetty-launcher-330-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 274682 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-11T02:53:22.224Z
[junit4] 2> 274694 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6155a608{SSL,[ssl, http/1.1]}{127.0.0.1:54360}
[junit4] 2> 274694 INFO (jetty-launcher-330-thread-5) [ ] o.e.j.s.Server Started @274824ms
[junit4] 2> 274694 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54360}
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@346d6714{SSL,[ssl, http/1.1]}{127.0.0.1:56640}
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.e.j.s.Server Started @274825ms
[junit4] 2> 274695 ERROR (jetty-launcher-330-thread-5) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56640}
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-11T02:53:22.237Z
[junit4] 2> 274695 ERROR (jetty-launcher-330-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 274695 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-11T02:53:22.237Z
[junit4] 2> 274718 INFO (zkConnectionManagerCallback-339-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 274718 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3b9e31be{SSL,[ssl, http/1.1]}{127.0.0.1:60443}
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.e.j.s.Server Started @274848ms
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60443}
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 274719 ERROR (jetty-launcher-330-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 274719 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-11T02:53:22.261Z
[junit4] 2> 274759 INFO (zkConnectionManagerCallback-343-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 274759 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 274777 INFO (zkConnectionManagerCallback-337-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 274778 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 274969 INFO (zkConnectionManagerCallback-335-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 274974 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 275003 INFO (jetty-launcher-330-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58360/solr
[junit4] 2> 275031 INFO (zkConnectionManagerCallback-341-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275032 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 275041 INFO (jetty-launcher-330-thread-5) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58360/solr
[junit4] 2> 275166 INFO (jetty-launcher-330-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58360/solr
[junit4] 2> 275181 INFO (zkConnectionManagerCallback-355-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275181 INFO (zkConnectionManagerCallback-347-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275183 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1061d2a0c240006, likely client has closed socket
[junit4] 2> 275192 INFO (zkConnectionManagerCallback-351-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275284 INFO (jetty-launcher-330-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58360/solr
[junit4] 2> 275374 INFO (jetty-launcher-330-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58360/solr
[junit4] 2> 275409 INFO (zkConnectionManagerCallback-363-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275449 INFO (zkConnectionManagerCallback-357-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275460 INFO (zkConnectionManagerCallback-369-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275467 INFO (zkConnectionManagerCallback-359-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275473 INFO (zkConnectionManagerCallback-365-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275489 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 275490 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54360_solr
[junit4] 2> 275491 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.Overseer Overseer (id=73778510327709709-127.0.0.1:54360_solr-n_0000000000) starting
[junit4] 2> 275498 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 275502 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60443_solr
[junit4] 2> 275797 INFO (zkCallback-364-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 275797 INFO (zkCallback-356-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 275813 INFO (zkConnectionManagerCallback-371-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 275823 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 275826 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 275883 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 275883 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41206_solr
[junit4] 2> 275986 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 276017 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 276021 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 276021 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57758_solr
[junit4] 2> 276043 INFO (zkConnectionManagerCallback-380-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276052 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 276054 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 276057 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 276057 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56640_solr
[junit4] 2> 276064 INFO (zkConnectionManagerCallback-384-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276069 INFO (zkCallback-364-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 276070 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 276071 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 276094 INFO (zkCallback-356-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 276277 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
[junit4] 2> 276277 INFO (zkCallback-370-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 276280 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 276289 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 276290 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 276290 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 276290 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 276290 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54360_solr
[junit4] 2> 276295 INFO (zkCallback-356-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 276295 INFO (zkCallback-370-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 276295 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 276296 INFO (zkCallback-364-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 276373 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 276407 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:41206_solr, 127.0.0.1:56640_solr, 127.0.0.1:60443_solr, 127.0.0.1:57758_solr]
[junit4] 2> 276433 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 276434 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 276465 INFO (zkCallback-383-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 276487 DEBUG (ScheduledTrigger-452-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 276624 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60443.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 276743 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60443.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 276744 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60443.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 276753 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node4/.
[junit4] 2> 276821 INFO (zkConnectionManagerCallback-393-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 276830 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 276831 INFO (jetty-launcher-330-thread-4) [n:127.0.0.1:60443_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 277283 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56640.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277354 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56640.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277354 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56640.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277365 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node2/.
[junit4] 2> 277545 DEBUG (ScheduledTrigger-452-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 277665 INFO (zkConnectionManagerCallback-398-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 277668 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 277670 INFO (jetty-launcher-330-thread-3) [n:127.0.0.1:56640_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 277677 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54360.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277722 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54360.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277722 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54360.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 277731 INFO (jetty-launcher-330-thread-5) [n:127.0.0.1:54360_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node5/.
[junit4] 2> 278597 DEBUG (ScheduledTrigger-452-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 279116 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57758.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 279182 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57758.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 279183 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57758.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 279193 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node3/.
[junit4] 2> 279297 INFO (zkConnectionManagerCallback-403-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 279299 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 279300 INFO (jetty-launcher-330-thread-1) [n:127.0.0.1:57758_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 279770 DEBUG (ScheduledTrigger-452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 280051 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41206.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 280106 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41206.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 280107 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41206.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 280108 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node1/.
[junit4] 2> 280143 INFO (zkConnectionManagerCallback-408-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 280148 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 280149 INFO (jetty-launcher-330-thread-2) [n:127.0.0.1:41206_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 280281 INFO (zkConnectionManagerCallback-410-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 280297 INFO (zkConnectionManagerCallback-415-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 280298 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 280300 INFO (SUITE-SearchRateTriggerIntegrationTest-seed#[91E9EA264AAC23FE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58360/solr ready
[junit4] 2> 281065 DEBUG (ScheduledTrigger-452-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 5
[junit4] 2> 281106 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=47
[junit4] 2> 281162 INFO (qtp754059860-1361) [n:127.0.0.1:54360_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 281205 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 281315 INFO (qtp868848117-1365) [n:127.0.0.1:57758_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=31
[junit4] 2> 281373 INFO (qtp1734438581-1351) [n:127.0.0.1:60443_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 281375 DEBUG (qtp754059860-1358) [n:127.0.0.1:54360_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 281377 DEBUG (zkCallback-383-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 281378 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 281382 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 281382 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 281382 INFO (qtp754059860-1358) [n:127.0.0.1:54360_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1019
[junit4] 2> 281741 INFO (TEST-SearchRateTriggerIntegrationTest.testDeleteNode-seed#[91E9EA264AAC23FE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteNode
[junit4] 2> 281742 INFO (TEST-SearchRateTriggerIntegrationTest.testDeleteNode-seed#[91E9EA264AAC23FE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 281745 INFO (TEST-SearchRateTriggerIntegrationTest.testDeleteNode-seed#[91E9EA264AAC23FE]) [ ] o.a.s.c.a.SearchRateTriggerIntegrationTest /autoscaling.json reset, new znode version 3
[junit4] 2> 281750 DEBUG (zkCallback-383-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 281751 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 281752 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 281753 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 281753 DEBUG (OverseerAutoScalingTriggerThread-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 286758 INFO (qtp754059860-1360) [n:127.0.0.1:54360_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=deleteNode_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 286789 INFO (OverseerThreadFactory-454-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection deleteNode_collection
[junit4] 2> 287069 INFO (OverseerStateUpdate-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deleteNode_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteNode_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:57758/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 287074 INFO (OverseerStateUpdate-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deleteNode_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteNode_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56640/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 287309 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr x:deleteNode_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteNode_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 287369 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr x:deleteNode_collection_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=deleteNode_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 288338 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 288363 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.s.IndexSchema [deleteNode_collection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 288417 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 288439 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 288439 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deleteNode_collection_shard1_replica_n1' using configuration from collection deleteNode_collection, trusted=true
[junit4] 2> 288440 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_57758.solr.core.deleteNode_collection.shard1.replica_n1' (registry 'solr.core.deleteNode_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 288440 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 288440 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SolrCore [[deleteNode_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node3/deleteNode_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node3/./deleteNode_collection_shard1_replica_n1/data/]
[junit4] 2> 288460 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.s.IndexSchema [deleteNode_collection_shard1_replica_n2] Schema name=minimal
[junit4] 2> 288464 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 288464 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'deleteNode_collection_shard1_replica_n2' using configuration from collection deleteNode_collection, trusted=true
[junit4] 2> 288465 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56640.solr.core.deleteNode_collection.shard1.replica_n2' (registry 'solr.core.deleteNode_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 288465 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 288465 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.SolrCore [[deleteNode_collection_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node2/deleteNode_collection_shard1_replica_n2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node2/./deleteNode_collection_shard1_replica_n2/data/]
[junit4] 2> 290009 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 290009 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 290011 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 290011 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 290013 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f208686[deleteNode_collection_shard1_replica_n1] main]
[junit4] 2> 290015 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 290016 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 290017 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 290017 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 290018 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 290019 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 290019 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 290021 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600134544163340288
[junit4] 2> 290032 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f53d676[deleteNode_collection_shard1_replica_n2] main]
[junit4] 2> 290034 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 290034 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 290035 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 290036 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600134544179068928
[junit4] 2> 290037 INFO (searcherExecutor-465-thread-1-processing-n:127.0.0.1:57758_solr x:deleteNode_collection_shard1_replica_n1 c:deleteNode_collection s:shard1 r:core_node3) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SolrCore [deleteNode_collection_shard1_replica_n1] Registered new searcher Searcher@7f208686[deleteNode_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 290047 INFO (searcherExecutor-466-thread-1-processing-n:127.0.0.1:56640_solr x:deleteNode_collection_shard1_replica_n2 c:deleteNode_collection s:shard1 r:core_node4) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.SolrCore [deleteNode_collection_shard1_replica_n2] Registered new searcher Searcher@7f53d676[deleteNode_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 290048 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 290059 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9997ms
[junit4] 2> 290063 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 290560 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 290560 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 290560 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:57758/solr/deleteNode_collection_shard1_replica_n1/
[junit4] 2> 290561 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=deleteNode_collection_shard1_replica_n1 url=https://127.0.0.1:57758/solr START replicas=[https://127.0.0.1:56640/solr/deleteNode_collection_shard1_replica_n2/] nUpdates=100
[junit4] 2> 290625 INFO (qtp906811787-1341) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.c.S.Request [deleteNode_collection_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=11
[junit4] 2> 290896 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=deleteNode_collection_shard1_replica_n1 url=https://127.0.0.1:57758/solr DONE. We have no versions. sync failed.
[junit4] 2> 290896 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 290897 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 290897 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 290909 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:57758/solr/deleteNode_collection_shard1_replica_n1/ shard1
[junit4] 2> 291011 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 291015 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteNode_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3705
[junit4] 2> 291072 INFO (qtp906811787-1340) [n:127.0.0.1:56640_solr c:deleteNode_collection s:shard1 r:core_node4 x:deleteNode_collection_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=deleteNode_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3703
[junit4] 2> 291077 INFO (qtp754059860-1360) [n:127.0.0.1:54360_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 291171 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 291171 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292084 INFO (qtp754059860-1360) [n:127.0.0.1:54360_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=deleteNode_collection&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=5325
[junit4] 2> 292094 INFO (qtp754059860-1358) [n:127.0.0.1:54360_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=deleteNode_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 292112 INFO (OverseerCollectionConfigSetProcessor-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 292120 INFO (OverseerThreadFactory-454-thread-2) [ c:deleteNode_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:41206_solr for creating new replica
[junit4] 2> 292126 INFO (OverseerStateUpdate-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"deleteNode_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteNode_collection_shard1_replica_n5",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41206/solr",
[junit4] 2> "node_name":"127.0.0.1:41206_solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 292242 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292242 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292651 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&name=deleteNode_collection_shard1_replica_n5&action=CREATE&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 292682 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 292722 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.s.IndexSchema [deleteNode_collection_shard1_replica_n5] Schema name=minimal
[junit4] 2> 292733 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 292733 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'deleteNode_collection_shard1_replica_n5' using configuration from collection deleteNode_collection, trusted=true
[junit4] 2> 292931 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292931 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 292933 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41206.solr.core.deleteNode_collection.shard1.replica_n5' (registry 'solr.core.deleteNode_collection.shard1.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 292933 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 292934 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.SolrCore [[deleteNode_collection_shard1_replica_n5] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node1/deleteNode_collection_shard1_replica_n5], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node1/./deleteNode_collection_shard1_replica_n5/data/]
[junit4] 2> 293409 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 293409 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 293411 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 293411 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 293417 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@163e06bb[deleteNode_collection_shard1_replica_n5] main]
[junit4] 2> 293421 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 293422 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 293423 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 293425 INFO (searcherExecutor-475-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.SolrCore [deleteNode_collection_shard1_replica_n5] Registered new searcher Searcher@163e06bb[deleteNode_collection_shard1_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 293429 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600134547736887296
[junit4] 2> 293462 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node6=0, core_node3=0, core_node4=0}, version=2}
[junit4] 2> 293466 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.ZkController Core needs to recover:deleteNode_collection_shard1_replica_n5
[junit4] 2> 293477 INFO (qtp1831873459-1332) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&name=deleteNode_collection_shard1_replica_n5&action=CREATE&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=825
[junit4] 2> 293482 INFO (qtp754059860-1358) [n:127.0.0.1:54360_solr c:deleteNode_collection ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=deleteNode_collection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1388
[junit4] 2> 293484 INFO (qtp754059860-1360) [n:127.0.0.1:54360_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=deleteNode_collection&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 293487 INFO (updateExecutor-360-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 293509 INFO (OverseerCollectionConfigSetProcessor-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 293513 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 293531 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 293535 INFO (OverseerThreadFactory-454-thread-3) [ c:deleteNode_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:60443_solr for creating new replica
[junit4] 2> 293543 INFO (OverseerStateUpdate-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"deleteNode_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteNode_collection_shard1_replica_t7",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:60443/solr",
[junit4] 2> "node_name":"127.0.0.1:60443_solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 293594 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.S.Request [deleteNode_collection_shard1_replica_n1] webapp=/solr path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 293594 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.S.Request [deleteNode_collection_shard1_replica_n1] webapp=/solr path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 293595 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[deleteNode_collection_shard1_replica_n5]
[junit4] 2> 293595 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 293595 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Publishing state of core [deleteNode_collection_shard1_replica_n5] as recovering, leader is [https://127.0.0.1:57758/solr/deleteNode_collection_shard1_replica_n1/] and I am [https://127.0.0.1:41206/solr/deleteNode_collection_shard1_replica_n5/]
[junit4] 2> 293608 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node6=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=3}
[junit4] 2> 293626 INFO (recoveryExecutor-361-thread-1-processing-n:127.0.0.1:41206_solr x:deleteNode_collection_shard1_replica_n5 c:deleteNode_collection s:shard1 r:core_node6) [n:127.0.0.1:41206_solr c:deleteNode_collection s:shard1 r:core_node6 x:deleteNode_collection_shard1_replica_n5] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:57758/solr]; [WaitForState: action=PREPRECOVERY&core=deleteNode_collection_shard1_replica_n1&nodeName=127.0.0.1:41206_solr&coreNodeName=core_node6&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 293652 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr x:deleteNode_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node6, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 293653 INFO (qtp868848117-1364) [n:127.0.0.1:57758_solr x:deleteNode_collection_shard1_replica_n1] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=deleteNode_collection, shard=shard1, thisCore=deleteNode_collection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41206_solr, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{"core":"deleteNode_collection_shard1_replica_n5","base_url":"https://127.0.0.1:41206/solr","node_name":"127.0.0.1:41206_solr","state":"down","type":"NRT","force_set_state":"false"}
[junit4] 2> 293711 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293711 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293711 INFO (zkCallback-370-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293725 INFO (zkCallback-370-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293760 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&name=deleteNode_collection_shard1_replica_t7&action=CREATE&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 293760 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 293795 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 293829 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.s.IndexSchema [deleteNode_collection_shard1_replica_t7] Schema name=minimal
[junit4] 2> 293956 INFO (zkCallback-379-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293956 INFO (zkCallback-358-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293956 INFO (zkCallback-370-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293956 INFO (zkCallback-370-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteNode_collection/state.json] for collection [deleteNode_collection] has occurred - updating... (live nodes size: [5])
[junit4] 2> 293957 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 293957 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.CoreContainer Creating SolrCore 'deleteNode_collection_shard1_replica_t7' using configuration from collection deleteNode_collection, trusted=true
[junit4] 2> 293958 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60443.solr.core.deleteNode_collection.shard1.replica_t7' (registry 'solr.core.deleteNode_collection.shard1.replica_t7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@39a9765d
[junit4] 2> 293958 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 293958 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.SolrCore [[deleteNode_collection_shard1_replica_t7] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node4/deleteNode_collection_shard1_replica_t7], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerIntegrationTest_91E9EA264AAC23FE-001/tempDir-001/node4/./deleteNode_collection_shard1_replica_t7/data/]
[junit4] 2> 294206 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 294206 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 294214 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 294214 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 294234 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.s.SolrIndexSearcher Opening [Searcher@30f8cb86[deleteNode_collection_shard1_replica_t7] main]
[junit4] 2> 294243 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 294243 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 294244 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 294245 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1600134548592525312
[junit4] 2> 294256 INFO (searcherExecutor-480-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.SolrCore [deleteNode_collection_shard1_replica_t7] Registered new searcher Searcher@30f8cb86[deleteNode_collection_shard1_replica_t7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 294274 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node6=0, core_node8=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=4}
[junit4] 2> 294276 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.ZkController Core needs to recover:deleteNode_collection_shard1_replica_t7
[junit4] 2> 294441 INFO (qtp1734438581-1350) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&name=deleteNode_collection_shard1_replica_t7&action=CREATE&collection=deleteNode_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=682
[junit4] 2> 294446 INFO (qtp754059860-1360) [n:127.0.0.1:54360_solr c:deleteNode_collection ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=ADDREPLICA&collection=deleteNode_collection&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=962
[junit4] 2> 294447 INFO (qtp754059860-1358) [n:127.0.0.1:54360_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params action=ADDREPLICA&collection=deleteNode_collection&shard=shard1&type=PULL&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 294465 INFO (OverseerCollectionConfigSetProcessor-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 294473 INFO (updateExecutor-352-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 294479 INFO (OverseerThreadFactory-454-thread-4) [ c:deleteNode_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:54360_solr for creating new replica
[junit4] 2> 294479 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 294485 INFO (OverseerStateUpdate-73778510327709709-127.0.0.1:54360_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"addreplica",
[junit4] 2> "collection":"deleteNode_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deleteNode_collection_shard1_replica_p9",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54360/solr",
[junit4] 2> "node_name":"127.0.0.1:54360_solr",
[junit4] 2> "type":"PULL"}
[junit4] 2> 294488 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 294488 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.ZkController deleteNode_collection_shard1_replica_t7 stopping background replication from leader
[junit4] 2> 294558 INFO (qtp868848117-1366) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.S.Request [deleteNode_collection_shard1_replica_n1] webapp=/solr path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 294558 INFO (qtp868848117-1366) [n:127.0.0.1:57758_solr c:deleteNode_collection s:shard1 r:core_node3 x:deleteNode_collection_shard1_replica_n1] o.a.s.c.S.Request [deleteNode_collection_shard1_replica_n1] webapp=/solr path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 294565 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[deleteNode_collection_shard1_replica_t7]
[junit4] 2> 294565 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 294565 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Publishing state of core [deleteNode_collection_shard1_replica_t7] as recovering, leader is [https://127.0.0.1:57758/solr/deleteNode_collection_shard1_replica_n1/] and I am [https://127.0.0.1:60443/solr/deleteNode_collection_shard1_replica_t7/]
[junit4] 2> 294569 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteNode_collection/terms/shard1 to Terms{values={core_node6=0, core_node8_recovering=0, core_node8=0, core_node6_recovering=0, core_node3=0, core_node4=0}, version=5}
[junit4] 2> 294580 INFO (recoveryExecutor-353-thread-1-processing-n:127.0.0.1:60443_solr x:deleteNode_collection_shard1_replica_t7 c:deleteNode_collection s:shard1 r:core_node8) [n:127.0.0.1:60443_solr c:deleteNode_collection s:shard1 r:core_node8 x:deleteNode_collection_shard1_replica_t7] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:57758/solr]; [WaitForState: action=PREPRECOVERY&core=deleteNode_collection_shard1_replica_n1&nodeName=127.0.0.1:60443_
[...truncated too long message...]
rkspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null25765245
[copy] Copying 40 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null25765245
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null25765245
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1516708797
[copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1516708797
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1516708797
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 42ms :: artifacts dl 2ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 158 minutes 20 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
[JENKINS] Lucene-Solr-Tests-master - Build # 2522 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2522/
2 tests failed.
FAILED: org.apache.solr.cloud.ConcurrentCreateRoutedAliasTest.testConcurrentCreateRoutedAliasComplex
Error Message:
concurrent alias creation failed org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42292/solr: Can't create collection alias for collections='testAliasCplx0_2017-12-25_23_24_25', 'testAliasCplx0_2017-12-25_23_24_25' is not an existing collection or alias
Stack Trace:
java.lang.AssertionError: concurrent alias creation failed org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42292/solr: Can't create collection alias for collections='testAliasCplx0_2017-12-25_23_24_25', 'testAliasCplx0_2017-12-25_23_24_25' is not an existing collection or alias
at __randomizedtesting.SeedInfo.seed([13F1FD94F96B8A5C:79A381DDBB3549C7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.cloud.ConcurrentCreateRoutedAliasTest.testConcurrentCreateRoutedAliasComplex(ConcurrentCreateRoutedAliasTest.java:133)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestPullReplica.testCreateDelete {seed=[13F1FD94F96B8A5C:BCB7B0243B59B940]}
Error Message:
Error from server at http://127.0.0.1:35479/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000010
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35479/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000010
at __randomizedtesting.SeedInfo.seed([13F1FD94F96B8A5C:BCB7B0243B59B940]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.TestPullReplica.tearDown(TestPullReplica.java:116)
at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13021 lines...]
[junit4] Suite: org.apache.solr.cloud.TestPullReplica
[junit4] 2> 1225422 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/init-core-data-001
[junit4] 2> 1225422 WARN (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=18 numCloses=18
[junit4] 2> 1225422 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1225436 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1225437 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001
[junit4] 2> 1225437 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1225437 INFO (Thread-723) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1225437 INFO (Thread-723) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1225461 ERROR (Thread-723) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1225537 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:45894
[junit4] 2> 1225648 INFO (zkConnectionManagerCallback-1036-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1225668 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1225669 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_172-b11
[junit4] 2> 1225702 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1225702 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@523f9cf7{/solr,null,AVAILABLE}
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1225703 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@524c0af6{/solr,null,AVAILABLE}
[junit4] 2> 1225758 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@84bfb1d{HTTP/1.1,[http/1.1]}{127.0.0.1:35479}
[junit4] 2> 1225758 INFO (jetty-launcher-1033-thread-1) [ ] o.e.j.s.Server Started @1225934ms
[junit4] 2> 1225758 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35479}
[junit4] 2> 1225759 ERROR (jetty-launcher-1033-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1225759 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1225759 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1225759 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1225759 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1225759 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-09T07:15:33.315Z
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@79c30fd7{HTTP/1.1,[http/1.1]}{127.0.0.1:46601}
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.e.j.s.Server Started @1225935ms
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46601}
[junit4] 2> 1225760 ERROR (jetty-launcher-1033-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1225760 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-05-09T07:15:33.316Z
[junit4] 2> 1225802 INFO (zkConnectionManagerCallback-1038-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1225810 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1225814 INFO (zkConnectionManagerCallback-1040-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1225869 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1225905 INFO (jetty-launcher-1033-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45894/solr
[junit4] 2> 1225925 INFO (zkConnectionManagerCallback-1044-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1225943 INFO (zkConnectionManagerCallback-1046-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1225961 INFO (jetty-launcher-1033-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45894/solr
[junit4] 2> 1226078 INFO (zkConnectionManagerCallback-1050-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1226244 INFO (zkConnectionManagerCallback-1054-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1226371 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1226372 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46601_solr
[junit4] 2> 1226373 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.Overseer Overseer (id=72594172261629958-127.0.0.1:46601_solr-n_0000000000) starting
[junit4] 2> 1226561 INFO (zkConnectionManagerCallback-1061-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1226641 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45894/solr ready
[junit4] 2> 1226642 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46601_solr
[junit4] 2> 1226751 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1226870 INFO (zkCallback-1060-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1227366 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1227401 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1227505 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1227505 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35479_solr
[junit4] 2> 1227506 INFO (zkCallback-1053-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1227624 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1227634 INFO (zkCallback-1060-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1227842 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1227880 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1227880 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1227914 INFO (jetty-launcher-1033-thread-2) [n:127.0.0.1:46601_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/.
[junit4] 2> 1228548 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1228567 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1228567 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1228585 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/.
[junit4] 2> 1228622 INFO (zkConnectionManagerCallback-1066-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1228624 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1228642 INFO (jetty-launcher-1033-thread-1) [n:127.0.0.1:35479_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45894/solr ready
[junit4] 2> 1228772 INFO (zkConnectionManagerCallback-1068-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1228861 INFO (zkConnectionManagerCallback-1073-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1228882 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1228883 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45894/solr ready
[junit4] 2> 1228964 INFO (SUITE-TestPullReplica-seed#[13F1FD94F96B8A5C]-worker) [ ] o.a.s.c.TestPullReplica Using legacyCloud?: false
[junit4] 2> 1228987 INFO (qtp1985270943-3971) [n:127.0.0.1:35479_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1228988 INFO (qtp1985270943-3971) [n:127.0.0.1:35479_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1229067 INFO (TEST-TestPullReplica.testCreateDelete-seed#[13F1FD94F96B8A5C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateDelete {seed=[13F1FD94F96B8A5C:8E10CD80F9B726C]}
[junit4] 2> 1229113 INFO (qtp115826095-3979) [n:127.0.0.1:46601_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=3&replicationFactor=1&collection.configName=conf&maxShardsPerNode=100&name=pull_replica_test_create_delete&action=CREATE&numShards=2 and sendToOCPQueue=true
[junit4] 2> 1229162 INFO (OverseerThreadFactory-1827-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection pull_replica_test_create_delete
[junit4] 2> 1229170 WARN (OverseerThreadFactory-1827-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 4 on collection pull_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 1229373 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46601/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229375 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35479/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229390 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46601/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229392 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"pull_replica_test_create_delete_shard1_replica_p4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35479/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229410 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46601/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229413 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p9",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35479/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229448 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p11",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46601/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229464 INFO (OverseerStateUpdate-72594172261629958-127.0.0.1:46601_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"pull_replica_test_create_delete",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"pull_replica_test_create_delete_shard2_replica_p14",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35479/solr",
[junit4] 2> "type":"PULL",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1229768 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_n1&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1229768 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1229784 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p2&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1229785 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node12&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_n6&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1229786 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p3&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1229803 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p14&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1229822 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p11&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1230007 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p9&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1230039 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node10&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p4&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL
[junit4] 2> 1230982 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231022 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231039 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231079 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_n6] Schema name=minimal
[junit4] 2> 1231081 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231081 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_n6' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231082 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.core.pull_replica_test_create_delete.shard2.replica_n6' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231082 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231082 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/pull_replica_test_create_delete_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/./pull_replica_test_create_delete_shard2_replica_n6/data/]
[junit4] 2> 1231173 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p3] Schema name=minimal
[junit4] 2> 1231176 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231236 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231236 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p3' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231237 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.core.pull_replica_test_create_delete.shard1.replica_p3' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231237 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231237 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/pull_replica_test_create_delete_shard1_replica_p3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/./pull_replica_test_create_delete_shard1_replica_p3/data/]
[junit4] 2> 1231269 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p2] Schema name=minimal
[junit4] 2> 1231271 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231271 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p2' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231272 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.core.pull_replica_test_create_delete.shard1.replica_p2' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231272 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231272 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/pull_replica_test_create_delete_shard1_replica_p2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/./pull_replica_test_create_delete_shard1_replica_p2/data/]
[junit4] 2> 1231326 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p11] Schema name=minimal
[junit4] 2> 1231328 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231328 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p11' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231329 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.core.pull_replica_test_create_delete.shard2.replica_p11' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p11') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231329 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231354 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231398 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p11] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/pull_replica_test_create_delete_shard2_replica_p11], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/./pull_replica_test_create_delete_shard2_replica_p11/data/]
[junit4] 2> 1231445 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p9] Schema name=minimal
[junit4] 2> 1231466 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231481 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231500 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1231721 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231721 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p9' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231721 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.core.pull_replica_test_create_delete.shard2.replica_p9' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p9') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231722 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231722 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p9] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/pull_replica_test_create_delete_shard2_replica_p9], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/./pull_replica_test_create_delete_shard2_replica_p9/data/]
[junit4] 2> 1231866 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1231868 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231868 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_n1' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231869 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46601.solr.core.pull_replica_test_create_delete.shard1.replica_n1' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231869 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231869 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/pull_replica_test_create_delete_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node2/./pull_replica_test_create_delete_shard1_replica_n1/data/]
[junit4] 2> 1231883 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard2_replica_p14] Schema name=minimal
[junit4] 2> 1231885 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231885 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard2_replica_p14' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231885 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.core.pull_replica_test_create_delete.shard2.replica_p14' (registry 'solr.core.pull_replica_test_create_delete.shard2.replica_p14') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231904 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1231904 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard2_replica_p14] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/pull_replica_test_create_delete_shard2_replica_p14], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/./pull_replica_test_create_delete_shard2_replica_p14/data/]
[junit4] 2> 1231948 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.IndexSchema [pull_replica_test_create_delete_shard1_replica_p4] Schema name=minimal
[junit4] 2> 1231950 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1231950 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore 'pull_replica_test_create_delete_shard1_replica_p4' using configuration from collection pull_replica_test_create_delete, trusted=true
[junit4] 2> 1231950 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35479.solr.core.pull_replica_test_create_delete.shard1.replica_p4' (registry 'solr.core.pull_replica_test_create_delete.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4314f79a
[junit4] 2> 1231950 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1232040 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore [[pull_replica_test_create_delete_shard1_replica_p4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/pull_replica_test_create_delete_shard1_replica_p4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_13F1FD94F96B8A5C-001/tempDir-001/node1/./pull_replica_test_create_delete_shard1_replica_p4/data/]
[junit4] 2> 1232373 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1232373 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1232375 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.SolrIndexSearcher Opening [Searcher@66177d22[pull_replica_test_create_delete_shard1_replica_p2] main]
[junit4] 2> 1232377 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1232378 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1232378 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1232390 INFO (searcherExecutor-1834-thread-1-processing-n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard1_replica_p2 c:pull_replica_test_create_delete s:shard1 r:core_node7) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p2] Registered new searcher Searcher@66177d22[pull_replica_test_create_delete_shard1_replica_p2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1232450 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1232450 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1232469 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p2 starting background replication from leader
[junit4] 2> 1232469 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1232487 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.s.SolrIndexSearcher Opening [Searcher@417e748e[pull_replica_test_create_delete_shard2_replica_p9] main]
[junit4] 2> 1232488 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1232488 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1232488 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1232519 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1232519 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1232756 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1232756 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1232751 INFO (searcherExecutor-1836-thread-1-processing-n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard2_replica_p9 c:pull_replica_test_create_delete s:shard2 r:core_node13) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p9] Registered new searcher Searcher@417e748e[pull_replica_test_create_delete_shard2_replica_p9] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1232684 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1232771 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1232771 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@faa8915[pull_replica_test_create_delete_shard2_replica_n6] main]
[junit4] 2> 1233016 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p9 starting background replication from leader
[junit4] 2> 1233016 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1233022 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1233022 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1233023 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1233024 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1233025 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ff7c576[pull_replica_test_create_delete_shard1_replica_n1] main]
[junit4] 2> 1233031 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1233031 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233047 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1233047 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1233063 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.s.SolrIndexSearcher Opening [Searcher@6a48bf0a[pull_replica_test_create_delete_shard2_replica_p11] main]
[junit4] 2> 1233063 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1233063 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1233064 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233066 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.s.SolrIndexSearcher Opening [Searcher@51ecfb1b[pull_replica_test_create_delete_shard1_replica_p3] main]
[junit4] 2> 1233066 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233066 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233066 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233066 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233067 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233067 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599969837053902848
[junit4] 2> 1233084 INFO (searcherExecutor-1832-thread-1-processing-n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard2_replica_n6 c:pull_replica_test_create_delete s:shard2 r:core_node12) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_n6] Registered new searcher Searcher@faa8915[pull_replica_test_create_delete_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233084 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233084 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233085 INFO (searcherExecutor-1837-thread-1-processing-n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard1_replica_n1 c:pull_replica_test_create_delete s:shard1 r:core_node5) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_n1] Registered new searcher Searcher@6ff7c576[pull_replica_test_create_delete_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233085 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1599969837072777216
[junit4] 2> 1233100 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233100 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233100 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233101 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233102 INFO (searcherExecutor-1833-thread-1-processing-n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard1_replica_p3 c:pull_replica_test_create_delete s:shard1 r:core_node8) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p3] Registered new searcher Searcher@51ecfb1b[pull_replica_test_create_delete_shard1_replica_p3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233104 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1233104 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1233125 INFO (searcherExecutor-1835-thread-1-processing-n:127.0.0.1:46601_solr x:pull_replica_test_create_delete_shard2_replica_p11 c:pull_replica_test_create_delete s:shard2 r:core_node15) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p11] Registered new searcher Searcher@6a48bf0a[pull_replica_test_create_delete_shard2_replica_p11] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233173 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.SolrIndexSearcher Opening [Searcher@10c80417[pull_replica_test_create_delete_shard2_replica_p14] main]
[junit4] 2> 1233182 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233182 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233183 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233184 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p14 starting background replication from leader
[junit4] 2> 1233184 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1233193 INFO (searcherExecutor-1838-thread-1-processing-n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard2_replica_p14 c:pull_replica_test_create_delete s:shard2 r:core_node16) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard2_replica_p14] Registered new searcher Searcher@10c80417[pull_replica_test_create_delete_shard2_replica_p14] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233209 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/pull_replica_test_create_delete/terms/shard1 to Terms{values={core_node5=0}, version=0}
[junit4] 2> 1233310 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1233310 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233327 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1233327 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1233329 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@58080549[pull_replica_test_create_delete_shard1_replica_p4] main]
[junit4] 2> 1233330 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1233330 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1233335 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p3 starting background replication from leader
[junit4] 2> 1233335 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1233336 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.ZkController pull_replica_test_create_delete_shard2_replica_p11 starting background replication from leader
[junit4] 2> 1233336 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1233339 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1233339 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233355 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1233392 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233392 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ZkShardTerms Successful update of terms at /collections/pull_replica_test_create_delete/terms/shard2 to Terms{values={core_node12=0}, version=0}
[junit4] 2> 1233372 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233400 INFO (searcherExecutor-1839-thread-1-processing-n:127.0.0.1:35479_solr x:pull_replica_test_create_delete_shard1_replica_p4 c:pull_replica_test_create_delete s:shard1 r:core_node10) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.SolrCore [pull_replica_test_create_delete_shard1_replica_p4] Registered new searcher Searcher@58080549[pull_replica_test_create_delete_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1233446 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.ZkController pull_replica_test_create_delete_shard1_replica_p4 starting background replication from leader
[junit4] 2> 1233446 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1233465 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1233465 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1233684 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1233684 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1233684 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard1_replica_n1/
[junit4] 2> 1233700 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1233720 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard1_replica_n1/ has no replicas
[junit4] 2> 1233721 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1233850 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1233850 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1233850 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard2_replica_n6/
[junit4] 2> 1233887 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1233923 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.SyncStrategy http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard2_replica_n6/ has no replicas
[junit4] 2> 1233923 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1234029 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard1_replica_n1/ shard1
[junit4] 2> 1234088 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46601/solr/pull_replica_test_create_delete_shard2_replica_n6/ shard2
[junit4] 2> 1234287 INFO (qtp1985270943-3966) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node7 x:pull_replica_test_create_delete_shard1_replica_p2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p2&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=4503
[junit4] 2> 1234292 INFO (indexFetcher-1858-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node12 is leader but it's state is down, skipping replication
[junit4] 2> 1234300 INFO (indexFetcher-1873-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
[junit4] 2> 1234302 INFO (indexFetcher-1875-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node12 is leader but it's state is down, skipping replication
[junit4] 2> 1234303 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1234304 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1234329 INFO (indexFetcher-1852-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
[junit4] 2> 1234338 INFO (qtp115826095-3978) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node12 x:pull_replica_test_create_delete_shard2_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node12&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_n6&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4554
[junit4] 2> 1234339 INFO (qtp115826095-3970) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node5 x:pull_replica_test_create_delete_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_n1&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4571
[junit4] 2> 1234496 INFO (qtp1985270943-3973) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node16 x:pull_replica_test_create_delete_shard2_replica_p14] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p14&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL} status=0 QTime=4693
[junit4] 2> 1234506 INFO (qtp115826095-3976) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard2 r:core_node15 x:pull_replica_test_create_delete_shard2_replica_p11] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p11&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL} status=0 QTime=4683
[junit4] 2> 1234507 INFO (qtp1985270943-3969) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard1 r:core_node10 x:pull_replica_test_create_delete_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node10&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p4&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=4468
[junit4] 2> 1234508 INFO (indexFetcher-1877-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
[junit4] 2> 1234618 INFO (qtp115826095-3972) [n:127.0.0.1:46601_solr c:pull_replica_test_create_delete s:shard1 r:core_node8 x:pull_replica_test_create_delete_shard1_replica_p3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard1_replica_p3&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=4832
[junit4] 2> 1234796 INFO (zkCallback-1053-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1234804 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/pull_replica_test_create_delete/state.json] for collection [pull_replica_test_create_delete] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1235170 INFO (qtp1985270943-4051) [n:127.0.0.1:35479_solr c:pull_replica_test_create_delete s:shard2 r:core_node13 x:pull_replica_test_create_delete_shard2_replica_p9] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=pull_replica_test_create_delete_shard2_replica_p9&action=CREATE&numShards=2&collection=pull_replica_test_create_delete&shard=shard2&wt=javabin&version=2&replicaType=PULL} status=0 QTime=5163
[junit4] 2> 1235252 INFO (qtp115826095-3979) [n:127.0.0.1:46601_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4]
[...truncated too long message...]
xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null1689893229
[copy] Copying 40 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null1689893229
[delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/null1689893229
resolve-example:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve-server:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.
-ivy-fail-disallowed-ivy-version:
ivy-fail:
ivy-fail:
ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/top-level-ivy-settings.xml
resolve:
jar-checksums:
[mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1723654580
[copy] Copying 246 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1723654580
[delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/null1723654580
check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 93ms :: artifacts dl 10ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...
-jenkins-base:
BUILD SUCCESSFUL
Total time: 279 minutes 12 seconds
Archiving artifacts
WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
WARN: java.lang.InterruptedException: no matches found within 10000
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)